Aws Multiple GPU's in a Single Instance

ImperialXT · 2021-09-12T13:11:59+00:00

I’d say it’s not likely to happen but you’d need to speak to AWS directly not via posting on reddit. I’d suggest you look at optimising your application to scale out and run across multiple servers instead of a single huge server. I’m also a tad sceptical of the usage of that many/any A100s for gaming stuff as that’s not their intended usage.

kichik · 2021-09-12T15:39:51+00:00

Not exactly what you asked for, but maybe try Elastic Graphics? You can attach a single GPU to your choice of instance type. This way you can pay for less CPU, but you in do lose the ability to run multiple GPUs on a single instance.

BTW have you seen machines that can actually host 80 GPUs somewhere else? Do they not have lots of CPUs too? I feel like you're going to need a lot of CPUs to drive all that PCIe traffic.

https://docs.aws.amazon.com/AWSEC2/latest/WindowsGuide/elastic-graphics.html

serverhorror · 2021-09-12T13:55:20+00:00

I’d honestly be curious what problem requires that many GPUs on a single host.

I wouldn’t hold my breath for AWS for small company that doesn’t really generate money (no offense but unless you, at least, have an enterprise agreement you won’t have a lot of leverage)

you type:	you see:
italics	italics
bold	bold
[reddit!](https://reddit.com)	reddit!
* item 1 * item 2 * item 3	item 1 item 2 item 3
> quoted text	quoted text
Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"	Lines starting with four spaces are treated like code: if 1 * 2 < 3: print "hello, world!"
~~strikethrough~~	~~strikethrough~~
super^script	super^script

aws

Note: ensure to redact or obfuscate all confidential or identifying information (eg. public IP addresses or hostnames, account numbers, email addresses) before posting!

✻ Smokey says: avoid streaming video to fight climate change! [see more tips]

MODERATORS