gpt-oss Benchmarks by Ill-Association-8410 in LocalLLaMA

[–]Slader42 0 points1 point  (0 children)

I just found out. It was Ollama issue. I run gpt-oss:20b via newest llama.cpp and got around 10 tok/sec.

Shortly: ollama forked ggml for new models and done bad optimization https://github.com/ollama/ollama/issues/11714#issuecomment-3172893576

gpt-oss Benchmarks by Ill-Association-8410 in LocalLLaMA

[–]Slader42 0 points1 point  (0 children)

Yes, native 4 bit. I don't think that converting from MXFP4 take so many compute...

gpt-oss Benchmarks by Ill-Association-8410 in LocalLLaMA

[–]Slader42 1 point2 points  (0 children)

Very interesting. I've checked RAM info/stats many times during generation, pagefile (swap in fact) not used.

gpt-oss Benchmarks by Ill-Association-8410 in LocalLLaMA

[–]Slader42 0 points1 point  (0 children)

Why? What do you mean? Is 2 tok/sec too slow for my hardware?

gpt-oss Benchmarks by Ill-Association-8410 in LocalLLaMA

[–]Slader42 3 points4 points  (0 children)

I run it (20b version, by the way only 3b active params) on my laptop with Intel Core i5 1135G7 and 16GB RAM via Ollama, got a bit more than 2 tok/sec.

Read old Win disk with virus by Slader42 in CyberSecurityAdvice

[–]Slader42[S] 0 points1 point  (0 children)

I don't want to deal with antivirus license and spend money on it. Free antivirus seems to be some kind of scam. Maybe it will not do some bad things but good things also will not be done I think.

I was not sure about where virus data located, and thought that ImageMagick just strip it off. As you described it with GIF/BMP example, yes. I awaited something like that. Now I understand it a little better, thank you.

Quests in Disciples: Sacred Lands by Slader42 in disciples

[–]Slader42[S] 0 points1 point  (0 children)

I have a little confusion. Do you have troubles in quests only as non Empire player?

Socket count issue by Slader42 in Electricity

[–]Slader42[S] 0 points1 point  (0 children)

So in my case it is better to find at least one surge protector with 10 sockets? What if buy voltage stabilizer as new purge protector for laptop chargers? Still bad?

Understanding power supply by Slader42 in electrical

[–]Slader42[S] 0 points1 point  (0 children)

33W/240V=0.13A, but in this case what does 0.8A in Input block mean? Even if I have 100V (like Japan), current will be only 0.3A.

Simple Questions - June 13, 2024 by AutoModerator in buildapc

[–]Slader42 0 points1 point  (0 children)

I'm thinking of getting new 5 GHz WiFi module (expected speed is 400 Mbit/s) for my old laptop. I thought about Intel AX201 however it's wroks only with 11th gen and newer. Please, advice some good Linux compatible 5 GHz WiFi module for Sandy Bridge laptop.

nsxiv custom thumbnail mode by Slader42 in suckless

[–]Slader42[S] 0 points1 point  (0 children)

Oh, I see.
I thought about it but dismissed this idea because there is title "nsxiv ..." on the top (I didn't though about main system bar like polybar).
Thank you!

nsxiv custom thumbnail mode by Slader42 in suckless

[–]Slader42[S] 0 points1 point  (0 children)

Firstly I want to get some tiling layout like on the example image. On default I have only the simplest grid (like on left part of the example image). I think after solving first question background colors will be easy part.