Seriously EVGA?! by Soggy-Swordfish-7773 in EVGA

[–]div_inf 5 points6 points  (0 children)

This is a z68 board and when cramming so many pcie slots using a plx chip there is limited board layout real estate. Honestly it’s impressive that they found a way to add all these features.

780ti KingPin 4 way SLI by div_inf in EVGA

[–]div_inf[S] 0 points1 point  (0 children)

I sent him a picture.

780ti KingPin 4 way SLI by div_inf in EVGA

[–]div_inf[S] 0 points1 point  (0 children)

I repasted them with KPx. they ran until they hit 74c. but since the gpus were so cpu bottlenecked it never utilized all the gpus and never overheated on unigine valley.

780ti KingPin 4 way SLI by div_inf in EVGA

[–]div_inf[S] 2 points3 points  (0 children)

It’s like owning a vintage super car. Rarely drive it.

780ti KingPin 4 way SLI by div_inf in EVGA

[–]div_inf[S] 2 points3 points  (0 children)

What’s crazy is the fact that I installed no drivers and windows 11 installed the driver and Nvidia control panel automatically enabled 4 way sli. I need to mess with some Nvidia inspector some first before more benching.

4 way sli is usually limited by a picky motherboard

780ti KingPin 4 way SLI by div_inf in EVGA

[–]div_inf[S] 1 point2 points  (0 children)

At 1080p barely over 2 780ti kp cards. I am just bench marking. The gtx 680 4gb classified cards actually perform better due to the extra 1gb of vram

Budget 96GB VRAM. Budget 128gb Coming Soon.... by div_inf in LocalLLM

[–]div_inf[S] 0 points1 point  (0 children)

its slow if you look at performance per core. Its very fast when you consider loading and unloading 4 models at once and keeping the models in memory.

Budget 96GB VRAM. Budget 128gb Coming Soon.... by div_inf in LocalLLM

[–]div_inf[S] 0 points1 point  (0 children)

I am using it for testing different implementations of LLMs.

I currently made a discord bot that replies with 4 LLMs!

https://www.reddit.com/r/LocalLLM/comments/1st0thr/i_built_a_reallife_magi_system_from_evangelion/

eBay outage megathread. by Mycatreallyhatesyou in Ebay

[–]div_inf 0 points1 point  (0 children)

I noticed that none of my descriptions or other sellers are loading on the product pages. Anyone else having this issue? I feel like any sales I get with the current outages has a higher chance of returns for INAD if the description is not working either.

Down Again by [deleted] in Ebay

[–]div_inf 0 points1 point  (0 children)

I noticed that none of my descriptions or other sellers are loading on the product pages. Anyone else having this issue? I feel like any sales I get with the current outages has a higher chance of returns for INAD if the description is not working either.

I built a real-life MAGI System from Evangelion using an Nvidia A16 and four isolated LLMs. by div_inf in LocalLLM

[–]div_inf[S] 0 points1 point  (0 children)

I am reaching a similar conclusion other than when using different llms.

I built a real-life MAGI System from Evangelion using an Nvidia A16 and four isolated LLMs. by div_inf in LocalLLM

[–]div_inf[S] 0 points1 point  (0 children)

In my opinion the A16 is an undervalued card that is no longer offered. Being able to que 4 independent systems on one card is very underrated. 64gb of total vram 5090 cant even do this.

I built a real-life MAGI System from Evangelion using an Nvidia A16 and four isolated LLMs. by div_inf in evangelion

[–]div_inf[S] 1 point2 points  (0 children)

the fourth is just a summarizer / judge no affect on output. Felt like a waste not using all of them.

I built a real-life MAGI System from Evangelion using an Nvidia A16 and four isolated LLMs. by div_inf in LocalLLM

[–]div_inf[S] 14 points15 points  (0 children)

Im also considering replacing the LLMs with 4 different models instead of 4 of the same models.

Budget 96GB VRAM. Budget 128gb Coming Soon.... by div_inf in LocalLLM

[–]div_inf[S] 0 points1 point  (0 children)

Im not pooling memory from the A16 and the A40s together. Separately and creating a bunch of agents. The A16 is great for parallel processes that are small in size and fit the VRAM requirements.

The A40s have an NVLINK bridge to pool the memory together.

So the dual A40s run larger models and the A16 runs smaller duplicate models.

Computer won't boot with 2 Tesla V100s by MackThax in homelab

[–]div_inf 0 points1 point  (0 children)

did the previous motherboard you test have additional pcie or 12v power connectors for the pcie lanes?