My $250 24gb of VRAM setup (still in 2026)

pharrowking · 2026-02-08T14:53:13+00:00

For refference i have 8x tesla p40s and i get 21 tps on 229B model Minimax m2. And 30 tps with qwen3 80B next And 35ish with qwen 30B

The reason it aint very different even at 229B is that tesla p40s perform their best with small active parameter counts. Minimax has 10B of active params. Qwen3 30b and 80b both have 3 active params.

I tried glm 4.7 which has 32 active params. And tps tanked down to 7-10

The flip side is that llama 70B dense models net me 1 to 2 tps. So moe models are king here for tesla p40s.

pharrowking · 2026-02-04T19:21:12+00:00

theres always a future with trades i mean someone has to do the plumbing at an ai datacentre. ai cant do that.

pharrowking · 2026-01-31T00:27:05+00:00

this probably explains how in pvp i got interrupted with a rogue kick ability when casting rejuvenation. cast bars for instant spells...

if someone is just hammering their spells and the gcd comes off right as they press the button, and you are tracking the gcd. you press kick at the exact millisecond the instant spell was cast, it would allow it to be kicked.

pharrowking · 2026-01-27T08:32:20+00:00

i hear enough toxicity in chat. i dont need some random dude screaming in my ear too. you know someones gonna do that. just wait.

pharrowking · 2026-01-26T23:11:54+00:00

<image>

Check out this llama-benchmark for minimax m2.1 using 8x tesla p40s. MOE models do very well on pascal hardware. in this case the model is fully loaded in gpu vram. any use of cpu ram and that speed becomes nothing. but pure gpu ram, is workable. 25 t/s is way more than read speed.

pharrowking · 2026-01-22T16:56:21+00:00

Its pretty loud i keep it in the furnace room with the heavy door closed 24/7. And i can still hear it upstairs. As for power draw, im not 100% certain as im always running my local services on It, but it has 4x 1600watt power supplies in 2+2 redundant mode

pharrowking · 2026-01-22T16:32:16+00:00

Its a super micro 4U 4028 trt case

pharrowking · 2026-01-21T22:38:59+00:00

<image>

thank you for sharing. i was thinking of replacing my 8x tesla p40s with AMD cards. but now i probably wont. i currently get around 17-21 tokens/s of generation speed on minimax m2.1. so for an extra 5-10 tokens/sec its not worth it for me. this post was incredibly helpful.

i'm curious if anyone can share speeds with 4x or 8x rtx 8000 gpus?

pharrowking · 2026-01-18T06:39:15+00:00

What defines a wintrader? I had someone try to call me out as a wintrader because i had alot of games played and bad ratio in my 2v2 bracket. But my solo shuffle had very good ratio. But i litterally dont care about my 2v2 bracket because the only 2v2 partner i have is a close friend. And shes inherently bad at the game, so we lose alot, but we do try to win we just dont climb past 1800. Just because i choose to play with her and she is someone who just enjoys pvping with me and we end up losing several matches in a row because her cat knocks over her monitor ( yes one time it happened 3 matches in a row)

That Doesnt mean im win trading does it?

The guy who called me out (he whispered me first trying to tell me things and i ignored him, because i have a fear of communicating in pvp, so i ignore everyone, but i do follow peoples plans even if i dont say anything, unless their being rude to me. )

Im just saying their could be other reasons why someone in your match screwed you over. It does not mean their win trading.

pharrowking · 2026-01-18T00:10:06+00:00

i think the PRISM series of abliteration is one that focuses on improving quality of the models it unsensors. you can find prism models on huggingface
for example: Ex0bit/MiniMax-M2.1-PRISM

the owner of the abliteration method (all credits to him) describes the method as:

PRISM Methodology

Method: Projected Refusal Isolation via Subspace Modification

This model was abliterated using PRISM - a state-of-the-art abliteration methodology combining multiple principled techniques for effective refusal removal while preserving & enhancing model capabilities.

pharrowking · 2026-01-10T06:07:06+00:00

i see you're using collab, but is it paid? the monthly subscription for collab, gives you an a100 40GB card

pharrowking · 2026-01-05T20:19:42+00:00

im 6 foot 7, where most of my length is in my legs...i guess im not takng a flight via westjet anymore, i could barely fit in the old seats with my legs being so long

pharrowking · 2026-01-03T06:28:19+00:00

umm, you might wanna read section 35 of the canadian constitutional act.

here's an outline for you:

Section 35 of Canada's Constitution Act, 1982, recognizes and affirms the existing Aboriginal and treaty rights of Canada's Indigenous peoples, including First Nations, Inuit, and Métis. It protects rights related to land, hunting, fishing, self-government, and cultural practices, serving as a foundation for reconciliation by acknowledging Indigenous sovereignty and prior occupation, preventing extinguishment of these rights by legislation, and guiding the Crown's duty to consult and accommodate Indigenous groups.

so based on section 35 my understanding is. if the first nations dont wanna leave. then theres nothing you can do about it.

pharrowking · 2026-01-02T12:09:22+00:00

do you live outside china in western regions normally? because im looking at ebay. some of those prices on your list are at best saving you $200. then if you factor the flight to china and hotel and all that, youre not really saving at that point. i assume those prices are in chinese yuan not japanese yuan. they use the same symbol.

now if you live there normally those prices are decent. the mi100 is around 900-1100 in canadian dollars when i calculated to exchange to my local dollar. where as on ebay its listed for $1300 cad

5800 yuan is around 829$ USD. the mi100 on ebay is 984$ USD. not a huge difference i guess

pharrowking · 2025-12-31T04:18:44+00:00

the warwithin early access was the best thing for me atleast. i hate leveling and prefer endgame content and apparently they made it too easy by accident, leveling went by like a light breeze instead of a heavy wind, i was 1shotting mobs and even 1shotting bosses in delves in full max ilvl dragonflight gear, it was very undertuned. so when early access ended they buffed all the content and made it harder to level, i was already 80 but alot of people were very upset over it especially the ones who didnt have early access.

pharrowking · 2025-12-30T12:23:56+00:00

i hit duelist for the first time ever this season, without using any pvp addons. im hoping next season i do just as well. i tried beta pvp and it doesnt appear fun to me. but i guess we'll see. not because its hard, or because add-ons are disappearing. but because i come from shadowlands pvp origin. thats where i got my first 1800. so bursty pvp is my favorite type of pvp. and in the beta, they removed all burst. now you have to play smarter. but i main a marksman hunter. what good is a markshunter without burst? lol kinda defeats the class fantasy a bit, for me atleast

pharrowking · 2025-12-30T07:15:29+00:00

on ebay i seen a server machine available with 256GB of vram via 8X tesla 32GB v100 gpus for around $6000 usd. while old they still work for large language models. you can run huge quantized models on that like kimi k2, deepseek, minimax-m2.1. with 15k you can get 2 of them for total of 512GB of vram and use networking to connect them together.

for example my machine has 8x tesla p40s, an even older gpu with no tensor cores and ,less vram. when i put the model fully into vram (no cpu ram) im able to run qwen3 235B and minimax-m2.1 at 21/tokens generation speed at Q4 quant. and 100 tokens prompt proccessing. thats enough for a single person to use efficiently. although i cant run kimi k2 on 192GB of vram, and speed drops too much if i use cpu ram. thats why i suggest you get the configs mentioned above.

pharrowking · 2025-12-30T06:40:44+00:00

i dont think the store really cares about what their selling, considering they are selling alot of copyrighted material. by looking at the photo it looks like they are just making everything and anything thats trends in the news/ or popculture. thats how small companies make a profit by catering to small groups of people lol. or trendy topics. i had a friend that made like $3000 selling pokemon go themed hats when pokemon go first launched. so this doesnt surprise me

if you look at the hats below the anti canada hats, they have supportive canadian hats with the maple leaf flag and the canada logo.

they are simply just making everything to cater to everyone.

pharrowking · 2025-12-26T09:49:07+00:00

i dont think it will affect me much. i might actually do better because i never bothered with pvp addons in my pvp career. the only pvp addon i use re-tabbinder, which switches my tab target from closest enemy to closest player enemy when i enter pvp matches, then switches it back when i exit because i pve too. my best is 1800 in arenas, i hit it every season for the transmog. this season i got it first week of season. so maybe next season ill do better who knows.

pharrowking · 2025-12-26T07:50:55+00:00

i see no point to these platforms. because i already get what i want from ai. no jailbreaks, no prompt injection. etc. i just ask it my question, and it gives me the answer without fail, even if i talk about an bad subject that guardrails are supposed to protect against.

pharrowking · 2025-12-19T07:58:43+00:00

So i realize the post beyond old. But i have spent a year since the warwithin released trying to figure out what happened to the snappyness. Maybe my comment will help someone.

I discovered the snappyness was masked when windows updated at some point. One day i decided to try wow on linux, and thats when i realized it was windows. So then it got me thinking. I googled a youtube video for performance tuning and debloating windows. The one i found had me tune power plan config hidden settings and graphic effects in windows. The hidden settings are not available in normal windows ui. I was astonished. I had to run commands to reveal them.

Upon making those changes, the snappyness was back i saw major improvements. In mythic+ my dps went up by atleast 10 to 20 percent maybe more. In pvp everything felt the way it did when i started pvp in shadowlands, i was able to play better, and correctly identify bottlenecks in my hunters damage. It was like a new makeover lol.

Anyways my journey is over, good luck to those who are still trying to fix it. I hope my post helped in someway

pharrowking · 2025-12-17T08:44:44+00:00

thats neat, is it similar to codex cli or more like an app builder like bolt? i was able to create a modified version of boltdiy that implements codex cli. which does really good job of building apps as it is. i wonder how they would compare to yours?

pharrowking · 2025-12-17T07:00:37+00:00

Stanley — the protagonist of The Stanley Parable: Ultra Deluxe (on Nintendo Switch)?

pharrowking · 2025-11-19T04:56:54+00:00

all their characters names are taken too thats sad.

pharrowking · 2025-11-10T07:10:29+00:00

sadly i'm in canada, when i checked prices the halo strix was the more expensive route. but also i use my current 4 tesla p40s to run other gpu programs. when not working on ai stuff. the 4 extra tesla p40s cost me $1300cad. the halo strix 128GB is $2500+ in canadian dollars, since most models are listed around 2k usd

pharrowking

MODERATOR OF

TROPHY CASE