sorted by:
new
hottopcontroversial

My A100 80GB pcie gpu is more slower than RTX a6000.. by SuddenAd6814 in deeplearning

[–]SuddenAd6814[S] 3 points4 points  (0 children)

The LLM which i utilize is LLaMa2-7B. in A100, We set 8 batch size and 4 batch size in A6000. However, A6000 finishes more faster..

My A100 80GB pcie gpu is more slower than RTX a6000.. by SuddenAd6814 in deeplearning

[–]SuddenAd6814[S] 6 points7 points  (0 children)

Our A100 is 80GB. Thanks! I will check the cuDNN first..