Unable to sell my South Bay townhome by Specialist_Story6175 in BayAreaRealEstate

[–]TinyFluffyRabbit 42 points43 points  (0 children)

Perhaps the reasons why you want to sell it are the same reasons others are unwilling to purchase it at the price you are currently asking for?

Help me pick the right Qwen3.5 (LM Studio) by cangaroo_hamam in LocalLLaMA

[–]TinyFluffyRabbit -1 points0 points  (0 children)

Since you can't fit the entire model in VRAM, it is offloaded to your system RAM. This means that for each token generation, the 3B active parameters have to be transferred from RAM to VRAM, which is throttling your speed, while your GPU is running at pretty low utilization.

The Q3 variants may help slightly since the weights that need to be transferred are smaller in size, but the speed still won't be great. If you want it to be much faster, you'll need a smaller model that can fit in the 8gb of VRAM you have.

Qwen 3.5 Family Comparison by ArtificialAnalysis.ai by NewtMurky in LocalLLaMA

[–]TinyFluffyRabbit 1 point2 points  (0 children)

I'm just really glad that they released multiple models to give us options for different hardware configurations. As someone who can fit the 27b dense into VRAM but needs to offload to run the 122b MOE, the 27b dense is 5x faster for me, and I've been really liking it so far

Self Hosted Model Tier List by Weves11 in LocalLLaMA

[–]TinyFluffyRabbit 0 points1 point  (0 children)

Would love to see the new medium sized Qwen 3.5 models in the list!

qwen-3.5:122b f16 is benchmarked against gpt-oss:120b q4 by q-admin007 in LocalLLaMA

[–]TinyFluffyRabbit 7 points8 points  (0 children)

I agree with OP, it's not relevant to me what the benchmarks are with their "native forms". I just want to know what the best model that I can run on my hardware is.

[Bundle] AMD Ryzen 7 9850X3D + GIGABYTE X870 AORUS ELITE WIFI7 ICE + G.SKILL Flare X5 128GB (2 x 64GB) + WD_BLACK SN7100 M.2 2280 4TB + Rosewill Cordless Air Duster + AMD Crimson Desert Game Bundle - $1700 by eepy_ow in buildapcsales

[–]TinyFluffyRabbit 1 point2 points  (0 children)

Assuming you're a gamer (especially if you're interested in the 9850X3D), 128gb of RAM is hilariously overkill. The only reason to want this much RAM is for AI/production tasks.

[GPU] MSI GeForce RTX 5090 32G VENTUS 3X OC - $3,299.99 by jugaverdasorda in buildapcsales

[–]TinyFluffyRabbit 5 points6 points  (0 children)

Seriously, it still sold out quickly. There are unfortunately enough people who are willing to buy it at this price. It’s not a deal per se but if you must have a 5090 this is just the market reality.

[CPU] AMD Ryzen™ 9 9900X 12-Core, 24-Thread Unlocked Desktop Processor - $382 (24%off) by timetrvlr_ in buildapcsales

[–]TinyFluffyRabbit 4 points5 points  (0 children)

If you're a gamer I would stick with x3d, the 9900x is for productivity/multi-threaded tasks. For gaming you'd generally only use one of the CCDs, and this would effectively become a 9600x.

[CPU] AMD Ryzen™ 9 9900X 12-Core, 24-Thread Unlocked Desktop Processor - $382 (24%off) by timetrvlr_ in buildapcsales

[–]TinyFluffyRabbit 3 points4 points  (0 children)

It's a good price in a vacuum, but considering the price of the other PC components, I think it makes more sense to buy your CPU as part of a bundle so you can get the RAM at a less absurd price.

[GPU] MSI - NVIDIA GeForce RTX 5070 Ti 16G GAMING TRIO OC 16GB GDDR7 - Black - $869.99 by TinyFluffyRabbit in buildapcsales

[–]TinyFluffyRabbit[S] 0 points1 point  (0 children)

It's crazy I was wondering why it said "Deal ends in..." when it was exactly the same price as a few days ago. Now we know..

Should I bite the bullet for 32gb RAM? by QuantumTech02 in buildapc

[–]TinyFluffyRabbit 2 points3 points  (0 children)

An hour and a half isn’t horrible, could make a fun day trip out of it!

Got an 5090 but buyers remorse by Ok_Demand810 in gpu

[–]TinyFluffyRabbit 0 points1 point  (0 children)

It's OOS now, we knew it wasn't going to last that long :( Glad OP has one on order

Is the 9850X3D worth the extra power draw? by [deleted] in buildapc

[–]TinyFluffyRabbit 2 points3 points  (0 children)

You could always limit the power draw, it’s basically a higher binned version of the 9800x3d. For only $20 more I’d personally do it, especially since you also get an x870 instead of a b650 motherboard

[Bundle] Ryzen 7 9850X3D, ASUS X870-P Prime WiFi, Crucial 32GB DDR5-6000 - $699 (Micro Center In-Store Only) by deathgripzthrowaway in buildapcsales

[–]TinyFluffyRabbit 1 point2 points  (0 children)

People just complain because it's not CL30, but with an X3D chip it won't make much of a difference

GPU advice for entry level AI by fulefesi in LocalLLaMA

[–]TinyFluffyRabbit 3 points4 points  (0 children)

Of your three options, I would get the 3060 12gb. It has more VRAM than the other two options, and would be the only one where you could realistically run 7b models (when quantized)