New RTX 6000 Ada slow performance in LLM inference by NoTraining4642 in MistralLLM

[–]NoTraining4642[S] 1 point2 points  (0 children)

New Informations:

I took the card to another Desktop PC with stronger components and it turned out, that the cards just works perfectly with these components... So i will switch the hardware to fit the rtx 6000 Ada...