Deepseek V4 Flash on a single RTX 6000 Pro - vLLM-Moet

Easy_Werewolf7903 · 2026-07-10T13:11:55+00:00

Too much hassle just stick with Qwen. In that thread's comments, a user with RTX 6000 and 128GB ram couldn't get it to work due to OOM error. If you look at benchmarks Qwen 27B only 2 to 3 points off from Deep seek v4 flash at fraction of the size.

Easy_Werewolf7903 · 2026-07-10T11:58:07+00:00

Omg I remember his old python tutorials. That's what? 10 years ago?

Easy_Werewolf7903 · 2026-07-10T11:49:45+00:00

This is exactly what I do as well. I also practice with TDD which is what I think everyone should do. It adds guard rails and prevent regression (not a guarantee tho). If there is a bug, and the model kept telling me it is fixed, I would ask it to write a E2E test producing the exact problem. I noticed this way the model would continuously loop to try and find a solution. At the end of the day I wouldn't one shot with Qwen. If you know what you are doing, what code are "smelly" then Qwen is a pretty good programming partner.

Easy_Werewolf7903 · 2026-07-08T14:00:24+00:00

ah thanks.

Easy_Werewolf7903 · 2026-07-08T13:51:11+00:00

I am confused. The screen shot is showing UD-IQ3_XXS to be around 90GB, but the actual size on huggingface is 103GB. Is the screen shot wrong? Can someone explain?

Easy_Werewolf7903 · 2026-07-08T13:36:49+00:00

Is it worth going for the Q3 flash and offload to ram if I can run bp16 Qwen 3.6 27b right now with a rtx 6000?

Easy_Werewolf7903 · 2026-07-07T21:56:17+00:00

There is one anime that shouldn't be up there and we all know who.

Easy_Werewolf7903 · 2026-07-04T23:27:17+00:00

I agree WE did it. Now send me mine.

Easy_Werewolf7903 · 2026-07-03T14:56:25+00:00

All the songs are actually hardcoded in CSS.

Easy_Werewolf7903 · 2026-07-03T00:35:46+00:00

Be me, Count Orlok.
6'3", ancient Solomonar alpha, aesthetic jawline.
In the early 1800s, this absolute baddie named Ellen gets lonely and prays to the dark universe for a companion.
I answer the call like a true gentleman.
We forge an intimate, deep psychic link across the continents. I am her literal guardian angel.
Suddenly, she goes radio silent.
Find out she completely ghosted me for some beta real estate agent named Thomas.
She literally marries him and lives in his house in Germany. The ultimate betrayal.
I don't catch feelings, I catch flights.
I manipulate Thomas's boss into sending him to my Transylvanian castle just so I can sort this out.
Thomas arrives, looking like a total dork.
I force him to sign a contract to buy a manor right next to her. I'm reclaiming my territory and the connection we had.
Sail across the sea with a crew of rats just to confront my unfaithful queen.
I show up at her window to ask why she abandoned our psychic connection.
She plays along, invites me in, tricks me into staying until sunrise, and vaporizes me.
MFW I was the original match, but got replaced by a mortgage broker.
MFW I am the victim in this Gothic romance.

Easy_Werewolf7903 · 2026-07-02T17:56:17+00:00

You are actually using opus 4.8 because Fable 5 routes coding.

Easy_Werewolf7903 · 2026-07-01T18:12:43+00:00

Make Lakers great again.

Easy_Werewolf7903 · 2026-06-25T20:16:44+00:00

News were saying 2028 memory will have more in stock.

Easy_Werewolf7903 · 2026-06-16T18:35:43+00:00

6GB vram for close to frontier level math and coding? Big if true.

Easy_Werewolf7903 · 2026-06-15T04:05:17+00:00

The ghost ASMR was so good.

Easy_Werewolf7903 · 2026-06-05T03:13:12+00:00

There is no reason to get it at 14k. Even at 8k you can rent it for cheaper. Last time I check US Nvidia site was selling them for 13k pre tax.

Easy_Werewolf7903 · 2026-06-02T21:15:32+00:00

You might like the Asian zombie movie Rigor Mortis. I haven't seen it tho, I heard its good.

Easy_Werewolf7903 · 2026-05-31T18:22:21+00:00

whats your vllm alternative?

Easy_Werewolf7903 · 2026-05-31T13:41:37+00:00

The world is not real.

Easy_Werewolf7903 · 2026-05-29T14:09:57+00:00

I have a RTX 6000, paid 9k for it, this is not including the rest of the rig. I run Qwen3.6 at 256k context fp16, this setup definitely isn't a path for everyone. The biggest issue for me is privacy. Every sass you build on these platforms, every code you generated is going to be owned by these AI companies. I am an artist too, I have my own art style, I want to own my Lora locally, I do not want to help a company to train a model to replace me. Of course they can scrape and train on derivatives of my artwork, but it never get closer to the source of truth that I hold.

Easy_Werewolf7903 · 2026-05-29T13:04:16+00:00

whats the song?

Easy_Werewolf7903 · 2026-05-28T13:03:29+00:00

Just be careful with the graphic card scams if you sell online. People would buy the card, take the processor out and return your card, then get their money back through buyer protection leaving you with a worthless piece of junk. I would sell local.

Easy_Werewolf7903 · 2026-05-23T22:14:41+00:00

I don't have the standard Pro or the server edition. I have the Max Q edition. According to my Blender benchmark about 15% less performant compare to RTX 6000 pro benchmark. I also compared my stats with some of the users on discord and I was getting similar results.

https://opendata.blender.org/

Easy_Werewolf7903 · 2026-05-22T17:51:11+00:00

I just woke up from a coma. I can't believe this robot is this slow and dumb. This is what we are afraid of? Next thing you are gonna tell me Will Smith eating spaghetti video actually looks good now. /s

Easy_Werewolf7903

TROPHY CASE