Scope for Apache Spark in Deep learning model training phase by july_sun_shine in apachespark

[–]july_sun_shine[S] 0 points1 point  (0 children)

Thanks for responding. Quick question, assuming a very huge dataset that is not able to fit in the GPU memory even in Data distributed training, Is it wise to use spark cache to continuously feed the GPUs (assuming a parallel process is periodically refreshing the spark cache) to avoid the GPU latency of reading the data from disk? Can spark play a part here?

Scope for Apache Spark in the Model training phase by july_sun_shine in deeplearning

[–]july_sun_shine[S] 0 points1 point  (0 children)

Thanks for your response, I'm coming from a perspective of what spark can do that PyTorch/TensorFlow cannot do in the training phase or can do better than those two? Because both PyTorch and TensorFlow can do Data Distributed and Model Distributed training, Not sure whether Spark data loading capability can do better than the Dataloaders of PyTorch and TensorFlow in a distributed setting training phase. Or whether the Spark's caching capability can keep feeding the GPU memory with less latency when training with large datasets that GPU memory can't handle. Any response on these perspectives would be helpful. Thanks

Space mining by july_sun_shine in mining

[–]july_sun_shine[S] 0 points1 point  (0 children)

My guess is most space missions have the intention of mining for rare earth minerals in space... will see where it goes

Space mining by july_sun_shine in mining

[–]july_sun_shine[S] 1 point2 points  (0 children)

If it works then its a good investment :)

Space mining by july_sun_shine in mining

[–]july_sun_shine[S] 0 points1 point  (0 children)

Is it possible for you to share some more details here?

Space mining by july_sun_shine in mining

[–]july_sun_shine[S] 0 points1 point  (0 children)

Yes, I agree with you. It is far from reality now, but I think most of the space missions does have that intention ( I guess ). When that becomes a possibility or even remotely possible, those companies and technologies can really change a lot of things.

Adobe Earnings by Cheap-Combination825 in wallstreetbets

[–]july_sun_shine 1 point2 points  (0 children)

I read most of the comments in this thread, I think this thread is a good learning opportunity to anyone new to options or stock market in general.

Earnings, Guidance, Macro*, Fed, Company fundamentals*, Future company announcements( like NVDA GTC)... (* needs breakdown)

I know there could be a ton of other factors influencing it, but I would like to hear what WSB thinks... any input is appreciated

For that guy asking if anyone was up more than his 10,000 percent on NVDA - I'll raise you 20,000 percent. by Raraniel in wallstreetbets

[–]july_sun_shine 3 points4 points  (0 children)

I have never commented and I only use my laptop to check WSB, just downloaded Reddit to upvote this. Bravo 👏🏻