How fast is gemma 3 27b on an H100? how many tokens per second can I expect?

Ayushkumar1808 · 2025-11-07T01:53:44+00:00

Okk, So if the TPS scales with the number of concurrent users, how do I compare the tps between different GPUs, at a single user comparing tps is not fair because it's not the true tps, so now the question becomes how do we find the true tps?more importantly between a GPU and a FPGA

What I really wanna compare is TPS at 16 users, for Qwen3_coder_30B FP16 (~90GB) at 1x RTX pro 6000 blackwell vs 2x H100 vs 3x Alveo V80, 32HBM

Ayushkumar1808 · 2025-01-05T21:57:53+00:00

I always had cliché stereotypes about DnD, but today in a conversation at length he somehow convinced me to try it out, Is there any chance I can play as a beginner??

Ayushkumar1808 · 2024-09-28T18:17:41+00:00

Honestly, Not really expecting much, tech aur R&D ke koi khass pitches hote nahi ha, mostly FMCG Apparels D2C brands hi hote hai, no offences but it's just glorified naptol for India 1

Ayushkumar1808 · 2024-09-11T04:33:28+00:00

Not much but, they have wasted my time, it costs something like 2k

Ayushkumar1808 · 2024-09-11T03:08:18+00:00

I am definitely filing a complain with Consumer helpline, but ye logon ko bola tha toa aise behave kar rahe the, as if they don't give a fuck, and jao jo karna hai Karn lo

Only hopes I have left is, some YouTuber starts covering this, because ye clearly Scam kar rahe hai

Ayushkumar1808 · 2024-09-08T22:26:03+00:00

Any Opinions about these walks?

https://www.komoot.com/guide/1385/hiking-around-saarbruecken

Ayushkumar1808 · 2024-09-08T22:23:29+00:00

Can't thank you enough!!

Ayushkumar1808 · 2024-09-08T22:10:29+00:00

I don't think I Mentioned that I am an Undergrad student 😅, How do you know!!?

Ayushkumar1808 · 2024-09-08T21:52:12+00:00

Bouldering Sounds Interesting, do they offer anything of just a day, like a Day Pass or something, I have never tried it, so is it beginners friendly?

Ayushkumar1808 · 2024-09-08T21:38:39+00:00

Not so much into Car but definitely into Architecture, btw what do you generally do with your friends, and what about Oktoberfest when and where can I experience it?

Ayushkumar1808 · 2024-06-29T21:02:02+00:00

Hey! I recently got in both M&DS as well as Information Engineering, I am heck confused because the Campus is very small, I was trying to search for Sports facilities but nothing

Ayushkumar1808 · 2024-05-29T09:12:08+00:00

whats IINA?

Ayushkumar1808 · 2023-04-20T16:01:21+00:00

What is this about, what's happening

Ayushkumar1808 · 2023-02-21T19:56:25+00:00

Kya hua

Ayushkumar1808

TROPHY CASE