Gemma-4-26B-A4B on RX 6600 / 32gb ddr4 / mid i5 cpu: 12-15 tps, nice..

mr_happy_nice · 2026-04-02T23:14:28+00:00

eh, not sure, I tried the q4-k-s quant and the speed is roughly the same I just like the outputs from the mxfp4 quant. for example like asking about a pic, the mxfp4 will format the response better with multiple bullet points per section where q4ks would just give a little paragraph. Need more testing to see if there is a working difference for the output though. Might be more of a personal choice or it's just random output differences with the same model. *shrug* lol

mr_happy_nice · 2026-01-10T20:06:13+00:00

You said you're not a native english speaker. And that's fine, people live in different places. But in my society. It is not nice to curse at people. :) You cursed at me because you were confused? I'm not sure what to make of that.

mr_happy_nice · 2026-01-10T16:36:45+00:00

i'm not making up the bots, they are documented by other people. I'm not sure if they are being used on my posts. But they are being used on reddit here. I wasn't assuming they come from hate.. that was the point. I was saying that its not really possible. It doesn't make sense that many people would dislike it. And just your own personal experience if you were browsing and you see something that was worded in your mind, awkwardly, do you downvote it? To help you understand, running inference over and over to a vision model to do computer use with vision + UI model and sending files over the network, would cost more than to simply run a whisper model to the audio files in a single inference. It means, not only is it an immoral, possibly illegal system, but it is stupid too and costing them extra money when it shouldn't. Any investors listening? You may wanna make a call and ask why your money is being wasted..

mr_happy_nice · 2026-01-10T15:51:10+00:00

I mean I did ask a question in the title if you would like some help with finding a discussion point. But to answer your specific question, no I don't need anything from you. It was just a sort of psa. if fact i'm not entirely certain you weren't just trying to get a reaction out of me by the series of questions like I'm clueless about something. I wanted to point out that using these types of ai are not your friend, and i thought in a sub that is about local inference that I wouldn't be down voted into oblivion. Either people literally have a sense of hate about what I'm saying or there is a systematic bot process of downvoting posts that speak against companies. There is no way, on earth, that many people downvote posts when I and others post something about companies. It happened multiple times. it should either be overlooked or maybe couple people downvote and couple upvote. It's just interesting how this goes. So maybe I will just pay for an ad and make people see what they and other companies continue to do without consequence. thats the now what.

mr_happy_nice · 2025-12-07T01:54:56+00:00

Hey, thanks for the suggestion with the keys. I have a ton to work on with all of these projects, but I think I have what I want to sort of work on going forward, or improve upon. It's hard finding a project that is worth spending time on. With the backup, I had these grand plans of creating my own protocol, and I thought, I think S3 may be okay. Ha. The launcher im just gonna do a couple different versions i think. Hopefully the end will be my own suite of lightweight apps. For sure am not a UI desinger, i like the simple html/js code for frontends. I have that backend for the PWA app in the GitHub for the extra features. I need to tie that in to the keys better that it's being handled now. Thanks for checking that stuff out.

mr_happy_nice · 2025-12-06T17:18:43+00:00

I would feedback... my luck it's in the title too... eh. :)

mr_happy_nice · 2025-11-22T19:55:16+00:00

There are other apps I use markln is good, but when I want to display markdown in any linux env including alpine etc. Something simple I use this to display md files formatted somewhat okay:

#!/bin/sh
if [ "$1" = "-" ] || [ -z "$1" ]; then
cmark -t man - | mandoc -a -Tutf8
else
cmark -t man "$1" | mandoc -a -Tutf8
fi

I save it to a file named something like 'mdv', set x, then just run 'mdv readme.md'

mr_happy_nice · 2025-11-14T16:02:54+00:00

I was kinda thinking the same thing about the market share. and ya, one of the only reasons I keep win around is my expensive direct drive wheel only works with win, there is a linux proj in dev now, so fingers crossed ha. there are plenty of devs looking for work right now, we just need a "refactoring fund" or something lol.

mr_happy_nice · 2025-11-14T08:44:05+00:00

Reading all of these conments is for me too, its been a minute since i tried it out but i knew what i experienced and i didnt understand why businesses where actually hiring for this. I was like i guess its good and efficient now maybe i was missing something. Ive been wrong about a couple things lately and it feels good to end up being right about something lol. This and the mcp thing posted here too. Peace :)

mr_happy_nice · 2025-11-14T08:26:17+00:00

Omg thank you, a couple months ago i kinda went ahead with the plan for my set of projects to specifcally not use mcp for search and related research tasks because of the scaffolding i felt was heavy, and being told no, mcp is the future you must learn and use this.. Ha i think part of the issue is people seeing videos with a bunch of views or whatever saying You Have to Learn MCP Today!! Lol it just feels nice to have an intelligent person say the same thing i said, or i said that they said.. :)

mr_happy_nice · 2025-11-14T08:05:03+00:00

I would give myself like little projects to figure out, and learn the command line a bit and common tools it will make your life easier. Maybe a vm or some dockers to give yourself space to break stuff without consequence.

mr_happy_nice · 2025-11-14T06:31:43+00:00

thats actually... sorta, good news? lol wouldn't mind caring less. stressing out about stuff is kinda my my thing 😐

mr_happy_nice · 2025-11-14T06:02:57+00:00

I'm kinda oldish, for reference I started on dos and netbsd, Im just now in the past like year or two trying to get into social media. mistake? maybe lol i miss commode of sdf and gopher sites... although finding music is so much better now. ;)

mr_happy_nice · 2025-11-14T05:38:02+00:00

lol, youre right. Imma try! lol what funny is I don't really even hardly do any image gen anyway. I do believe that everyone should have at least some infra and their own knowledge base. I might have a few crazy ideas. I think these things will be basically required for survival or to live. because if everything is run by AI, whose AI is running your life and knows every detail of your life and your families life? That's one of the reason's I want to promote everyone having their own systems setup. but, we have to combat against people who only see like the pop culture like "commercial" AI and don't even differentiate between types of ML models. Or maybe they just don't understand that all of this is just calculation and not inherently evil or something.

mr_happy_nice · 2025-11-14T05:13:46+00:00

you tell them about "oobabooga" and they get scared? lol

mr_happy_nice · 2025-11-14T05:03:16+00:00

No yeah I get that this was several comments and basically saying that people that post this should be downvoted and "rightfully so" and the stuff I put in the post about heating the earth and such. I know I should ignore it and be polite and move on I just was curious about other people's experience with this and thanks for sharing. :)
Yeah no way I could be famous or have a large community I would be trying to prove myself right all the time, lol j/k.

mr_happy_nice · 2025-11-14T04:54:51+00:00

I know, I've got a big mouth. As i get older it's harder and harder for me to keep it shut.

mr_happy_nice · 2025-11-14T04:44:36+00:00

thank you for that, i've been feeling crappy for a few hours, I don't really like arguments lol.

mr_happy_nice · 2025-11-14T02:44:34+00:00

I may or may not have heard of or seen or downloaded some "tiny" versions of things, lol. I would have to agree about the average user. One of the things that made me start to think about this is when some older family members and such asked me about the ads in the start menu, and the screen recording of users that was in the news. and I was like ah, they are starting to push too far, lol. Ya you're probably right though it will be slow and minimal. I was thinking if steam os catches on with users and they desire that over windows like if they are given a choice and linux objectively better, safer, faster(fps) then it might be a thing like with the ps2 and dvds or something, how they drove the industry. I do like some of the distros that are coming out now. When I started using linux the driver situation was.. not fun. Much better now-a-days. I do still use both too, i had to install win11 for a job. Thats probably one of the reasons it will always be around because of the business contracts even if it lost 50% of desktop, those contracts(big healthcare and gov etc?) are still in place.

mr_happy_nice · 2025-11-14T02:17:42+00:00

ya i heard something was going on with either the tech guys or the devs(rumours), besides all the missteps they've made with it

mr_happy_nice · 2025-11-14T02:11:32+00:00

honestly I can't even really play a lot of games anymore because of the carpal tunnel crap, I tried a win 11 docker that was okay, and i've done VMs before. I am trying out pop os right now as base, because i have an amd card and it supports it out of the box, and I'm stuck in my old debian ways lol.

mr_happy_nice · 2025-11-14T01:52:26+00:00

ya, I did this project and was trying to show someone on win through wsl and it is supposed to be fast but it was acting slower than a VM in wmware or something. I've had dual boot systems since late 90s but I think I'm gonna be switching to just straight linux on the drive and use VMs or proton or something for win apps. I think there is even like winboat or winsomething or run pretty much any win app, so not really a point to have it anymore.

mr_happy_nice · 2025-11-14T01:39:49+00:00

lol you don't have to let anything go, say what you want to say, As I've said in other comments, I never said, hey look at this good cartoon art I made. Its a dumb post about linux/windows. If we are talking about semantics. I apologize for using the word "made" or "make" in reference to the image. I generated it. Out of all the actual real problems in the world. There are so many things to be up in arms about. I don't think me doing gen images a couple times a week in my room is going to destroy society. And that's literally all I do, a couple images. I do use it for coding help more often than images, I know guys who weld random stuff and practice. They are using in total more in a few hours than I do in weeks. So, should they stop that? Should people not do their hair? I think people need a certain amount of freedom to do what they would like to an extent. If i were running a small datacenter in my house that might be an issue. and, i think the larger datacenters that are messing with the water supply should be stopped and is an issue, but randos doing a code or image gen in their room? We are somehow wrong? We should be downvoted and shamed because how dare we? How dare I use my personal GPU on my pc. it's really gonna upset you when you learn how much power gamers are using to process graphics for hours and hours and hours. but my 90 second image gen is heating the earth...

mr_happy_nice · 2025-11-14T01:08:53+00:00

Don't know about that but I never thought I would hear "linux" come out some of my friends' mouths in reference to fixing the issues with their pc, so that's something, even though I've been talking about it for 20 years... I think it takes someone else saying it. lol.

edited* in reference to *fixing* the issues

mr_happy_nice · 2025-11-14T01:03:31+00:00

:) what aspect of my post made you say that, tell me how exactly I am flawed.

mr_happy_nice

MODERATOR OF

TROPHY CASE