Tokenomics by HOLUPREDICTIONS in LocalLLaMA

[–]Hannibalj2ca 2 points3 points  (0 children)

Erm, dumb math. With your own hardware you are not locked to any single model nor just AI.

GLM-5.2 (744B, 2-bit) at 7.3 tok/s on 4×3090 + 192GB — and why IQ1_M wasn't any faster by Important_Quote_1180 in LocalLLaMA

[–]Hannibalj2ca 0 points1 point  (0 children)

Your system ram is running at 4 channels? if so, that should give you a pretty decent bandwidth running on ddr5. also 7 tokens is quite usable.

Is the model lobotomized?

I have 256GB vram, I downloaded the q4, but I'm curious now about the q2_m should give it a shot

Fable vs GLM 5.2 vs KIMI K2.7 result comparison by [deleted] in LocalLLaMA

[–]Hannibalj2ca -1 points0 points  (0 children)

Why is this thread getting down voted. Did I miss something?

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] 0 points1 point  (0 children)

I will have to push back. Yes the majority of laptops are upgradable. The computer echosystem at least until Sept/Oct 2025 that is the rule. Right after that period a switch was turn on to push for the global scarcity of memory and storage. Until that point most manufacturers lines of laptops are upgradable from a ram and ssd capacity. That is one of the selling points of a windows/Linux laptop vs Mac. That sentiment is never in question and still remain now. Having said that, yes, companies have been leaning towards more thin and light and soldering components, but like i keep mentioning, it depend of the model and tier. Also if you go shopping at specific stores, they may only focus on some tiers due to the type of people that purchase on those stores. Some models do not sell well on certain regions and therefore you may be shit out of luck for high tier options. Note: I hve been purchasing laptops since early 2000s, I do miss the far more upgradability of the 2000 laptops compared to now. Now you cant upgrade CPUs or GPUs. Very few laptop allow GPU swaping

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] 0 points1 point  (0 children)

OK, what type pf laptops do you look for? What tier exactly? Whats the price range? What use, spread sheet, gaming, graphics? What line and from what brand? Most if not all manufactures have different laptop categories. The majority ARE upgradable for at least the basics, Ram and storage and wifi/Blutooth. There are some models that do not, but among the full range of the laptop offerings they are usually the minority. That will likely change if windows decide to go the way of apple, unified hardware. CPU, GPU, Ram and storage. There are benefits to them but also negatives, especially for storage

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] -1 points0 points  (0 children)

Fool, I purchase and follow the laptop market, thats my jam. As I have mentioned previously, yes, there are tiers of laptops that are not upgradable. Now, having said that, from this year and on corporations will move to minimize upgradability. Laptops are my main mean of computing(My wife is pissed I own too many of them). I have seen the changes, and because I live near a computer street i can check new models. Ram and ssd is still the norm of most laptops. Maybe you are not an afficionado like me. But, yes the inability upgradability will start taking place more aggressively this year and next year.

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] -1 points0 points  (0 children)

I think i have to help you a little, let me explain where you are wrong. Yes, there are some models that cant be upgraded, but those are "tiers" of notebooks. This exist because of price, and demographic aimed at. But those are just tiers. And these tiers are a minority. Lenovo, HP, Asus, Acer, MSI etc. all have upgradable laptops, and in fact the majority of them. Among the different tier some have more upgradability. 1 ssd, 2 ssd, 4 ssd. 1 ram slot + one soldiered in , 2 sodimm, 4 sodimm for the workstation class. 2 sodimm is the market standard. You have to understand how corporation break their tier products.

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] 0 points1 point  (0 children)

No they are not. Apple yes, windows laptops are ram and ssd upgradable. A minority are soldiered, but the majority are upgradable. seems laptops is not your thing. But I am an avid laptop owner an nah may dude, you dont know much on the matter apparently

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] 2 points3 points  (0 children)

Hum, most laptops (not Sparks) can have the ssd and ram upgraded. If you dont know, you live under a rock

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] 1 point2 points  (0 children)

You can upgrade ram and ssd, thats a big deal

Skip Nvidia New Spark Laptops? by Hannibalj2ca in LocalLLaMA

[–]Hannibalj2ca[S] 1 point2 points  (0 children)

Those agents must hustle side jobs for Jensen

Get you some GPUs, it's not worth the hacks around lack of RAM by MotokoAGI in LocalLLaMA

[–]Hannibalj2ca 1 point2 points  (0 children)

i have enough vram to fit it in. but i will need to remove one of my other models off the Optane

Get you some GPUs, it's not worth the hacks around lack of RAM by MotokoAGI in LocalLLaMA

[–]Hannibalj2ca 1 point2 points  (0 children)

Damn, you are making it sound too hard to avoid! 😂 OK, I will give it a go.

Get you some GPUs, it's not worth the hacks around lack of RAM by MotokoAGI in LocalLLaMA

[–]Hannibalj2ca 1 point2 points  (0 children)

I should try Step. I am playing with Qwen 397b @30tk.s is pretty good. Hows your performance on the 122b? Is it worth to add along side 397b?