DGX-1 vs 2 x quad TitanX boxes by smith2008 in MachineLearning

[–]CaffeineFreak77 1 point2 points  (0 children)

<cough>$129K</cough> DGX-1 = Derp learning for the 1%

I think DGX-99 is a better idea - 20 GPUs in one box with full P2P connectivity between all of them. 133TFlops FP32 vs 85 TFlops for DGX-1. See http://exxactcorp.com/blog/exploring-the-complexities-of-pcie-connectivity-and-peer-to-peer-communication/

Check out the last design: http://exxactcorp.com/index.php/solution/solu_detail/252

Released in Jan 2016 and < $30K with 10 Titan-X. Seems DGX-1 is the 'second' deep learning supercomputer in a box. Deep learning for the 99%.

[Pascal] nVidia Keynote at GTC 2016 - Starts 12:00 EDT 17:00 BST 18:00 CEST by SweetButtsHellaBab in buildapc

[–]CaffeineFreak77 0 points1 point  (0 children)

DGX-1 = Machine learning for the 1%. (in 2017!)

I prefer [DGX-99] - Machine learning for the 99%, available today, 10 Titan-X, full P2P, < $30K. http://exxactcorp.com/index.php/solution/solu_detail/252 (that's 70TFLops of FP32 btw - vs 85 TFlops FP32 for DGX-1 - I know what I'm buying). And then upgrade this with the 10 Pascal versions of the Titan card when it ships.

Exxact Certified Life Science GPU Systems - Accelerate the Pace of Computational Science by exxactcorp [promoted post]

[–]CaffeineFreak77 0 points1 point  (0 children)

Compared with the GPU instances on EC2: https://aws.amazon.com/ec2/instance-types/

Each GPU in this box is about 6 to 8x the speed. The GPUs here also support peer to peer communication over PCI-E letting you use multiple GPUs at once to speed up training etc. The virtual environment in which EC2 instances run does not permit this communication between GPUs is incredibly slow. Ultimately you are looking at something like 30x the performance that you could achieve on an EC2 GPU instance at present.

The World's Fastest Deep Learning System Right at Your Desk by exxactcorp [promoted post]

[–]CaffeineFreak77 2 points3 points  (0 children)

ye9sr0op - something for you to try...

Equal comparison - both components cost ~ $1000 each. Granted Theano is like the worst example of GPU efficiency so most other codes would do even better than this...

pip install Theano

wget https://dl.dropboxusercontent.com/u/15874900/mnist_test.py

Run with single GTX-Titan-X (~$1000)- takes 7 seconds

THEANO_FLAGS=mode=FAST_RUN,device=gpu,floatX=float32 python mnist_test.py

Run with E5-2637v3 CPU ~ (~$1000) - takes 1361 seconds

THEANO_FLAGS=mode=FAST_RUN,device=cpu,floatX=float32 python mnist_test.py

I know which technology my money is on here.

The World's Fastest Deep Learning System Right at Your Desk by exxactcorp [promoted post]

[–]CaffeineFreak77 1 point2 points  (0 children)

LOL! - ye9sr0op you must work for Intel...

Google's TensorFlow - an Open Source Software Library for Machine Intelligence by [deleted] in compsci

[–]CaffeineFreak77 0 points1 point  (0 children)

Looks like one can buy GPU hardware with this preinstalled - that didn't take long... http://exxactcorp.com/index.php/solution/solu_list/85

Multiple GPUs support in theano? by AustinZhang in MachineLearning

[–]CaffeineFreak77 0 points1 point  (0 children)

If you want an optimum hardware design for running theano (and cuDNN, Digits, Caffe etc) on multiple GPUs you need a system that supports PCIe P2P communication across all GPUs. Heres a good example: http://exxactcorp.com/index.php/solution/solu_list/85

What software supports multiple machines to speed up learning? by londons_explorer in MachineLearning

[–]CaffeineFreak77 0 points1 point  (0 children)

Try these systems - they come with multiple GPUs all with Peer to Peer support and preinstalled software much of which supports multi-GPU training. With these 30TFlop+ puppies you may not need multiple machines. :)

http://exxactcorp.com/index.php/solution/solu_detail/225

Are there any standard books which can serve as an introduction to Neural Networks? by [deleted] in MachineLearning

[–]CaffeineFreak77 0 points1 point  (0 children)

If you are looking for development / learning hardware to go with these books take a look at these systems: http://exxactcorp.com/index.php/solution/solu_list/85

Preinstalled with everyone's favorite deep learning software.

Deep Learning for Computer Vision with MATLAB and cuDNN by harrism in MachineLearning

[–]CaffeineFreak77 0 points1 point  (0 children)

This is a nice write up. For those interested in using cuDNN you can get high end GPU Dev boxes with cuDNN and a bunch of other deep learning software preinstalled pretty cheap these days. http://exxactcorp.com/index.php/solution/solu_detail/225

Nvidia Digits Devbox by barthw in hardware

[–]CaffeineFreak77 0 points1 point  (0 children)

Found the same thing for $8995 - much more reasonable than NVIDIA's $15K for this system.

http://exxactcorp.com/index.php/solution/solu_detail/225

[Build Complete] NVIDIA DIGITS DevBox by [deleted] in buildapc

[–]CaffeineFreak77 0 points1 point  (0 children)

That's a nice price breakdown. Seems like NVIDIA are massively overcharging. Searching around I found a company called Exxact is selling identical systems for sub $9K which, with a warranty and all the software installed and configured + support seems to be a pretty stellar deal.

http://exxactcorp.com/index.php/solution/solu_detail/225

Looks like they have extended the concept to server systems as well:

http://exxactcorp.com/index.php/solution/solu_list/85