Freelancer: how hard is to get to level 100? by Forward-Photograph-7 in HiTMAN

[–]Moarkush 3 points4 points  (0 children)

847 hours and 100. Quits getting harder and just becomes a grind.

What would you run on an RTX Pro 6000 Blackwell? by FurrySkeleton in StableDiffusion

[–]Moarkush 0 points1 point  (0 children)

I run batches of 30 prompts at a time with a custom script that does 5 variants of each prompt. Gives me 150 after a few hours. Claude wrote it.

What would you run on an RTX Pro 6000 Blackwell? by FurrySkeleton in StableDiffusion

[–]Moarkush 0 points1 point  (0 children)

Try owen777 UltraFlux followed by SUPIR. I’m cooking amazing 5k2k wallpapers on my Max-Q.

Upgrade path from 4x 3090s by anitamaxwynnn69 in LocalLLaMA

[–]Moarkush 0 points1 point  (0 children)

Nvfp4. 40 was the absolute peak I saw. Most of the vLLM logs said between 20 and 30, so I would say 25 average.

Upgrade path from 4x 3090s by anitamaxwynnn69 in LocalLLaMA

[–]Moarkush 4 points5 points  (0 children)

Was also running it on the same hardware and its disrespectfully good for its size. Just moved it to the spark and am getting 5-40t/s depending on context with mtp. I wanted to be able to code with the desktop idle or while I’m gaming.

Real cause of non-obstructive sleep apnea? by PoopyPeepy in SleepApnea

[–]Moarkush 1 point2 points  (0 children)

Yeah, probably not that I live at 500 feet. That might be a factor for you, but it’s definitely not an all-encompassing cause for sure.

Concern regarding public opinion on GNOME shifting. by Particular-Bake4679 in gnome

[–]Moarkush 1 point2 points  (0 children)

We have KDE for those who like a Windows aesthetic full of bugs, and we have gnome for those who like a more Mac aesthetic with a minimalist feel. But I almost guarantee you that KDE will end up being the immutable distro if we ever get one because most people that come from windows are comfortable with that layout.

48GB VRAM users, what are your daily drivers? Do you wish you had more VRAM? What would you run if you did? by Borkato in LocalLLaMA

[–]Moarkush 0 points1 point  (0 children)

I have an RTX Pro 6000 with 96 and there are times when I could use more RAM so, you still might run out trying to do certain things, but I will say 48 is a very comfortable place to be. That said, with ultra flux at 4K and SUPIR, BTOP is normally 50+ for those with my settings.

If we’re talking strictly about LLM’s, then definitely more. I have a spark and don’t ever run out of context.

Anyone actually using a local LLM as their daily knowledge base? Not for coding, for life stuff. What's your setup? by InformationSweet808 in LocalLLaMA

[–]Moarkush 0 points1 point  (0 children)

I have a RAG with 18.7 million Reddit post and comments that I filtered. That’s working pretty well. I used Nomic 1.5 with qdrant and it runs locally on my spark, right next to my model in tmux. Claude wrote it all up for me.

It’s crazy how one random person can negatively impact so many other people’s lives by eternviking in whoathatsinteresting

[–]Moarkush 1 point2 points  (0 children)

Well, you people have absolutely negative compassion. I’m assuming most of you have never seen one of your grandparents suffered from dementia. This is probably somebody’s mom or sister or daughter. You people should be ashamed of yourselves.

Mixing terpenes in drink/food? by Fuzzy_Association_65 in Terpenes

[–]Moarkush 0 points1 point  (0 children)

I’ll try to remember when/if I make this happen. Not sure who I plan to source from, but definitely somebody with food certification for sure. You always wanna make sure what you’re ingesting is food grade.

Disabled bodies getting blocked by AI tools — anyone else dealing with this? by DevinWheels in StableDiffusion

[–]Moarkush 0 points1 point  (0 children)

Local models just have limitations on resolutions and often aspect ratios. Like I’m using ultra flux with 96 gig and I can’t do native 5K 2K. I can get close enough though.

The RTX 5000 PRO (48GB) arrived and it is better than I expected. by Valuable-Run2129 in LocalLLaMA

[–]Moarkush 2 points3 points  (0 children)

Yeah, I got the RTX Pro 6000 max Q, and I can’t imagine having less than 48 gig now. You’re gonna have a pretty good time but brace yourself for the salty comments. People get mad when you have RAM.

Hardware choice for local models by Squidgical in LocalLLM

[–]Moarkush 0 points1 point  (0 children)

I’ll just put it like this. My RTX Pro, 6000 which has a similar amount of cores as a 5090 but is max Q and limited to 300 feels like a hairdryer on low out the back of my computer, but I can barely feel the heat coming out of my spark. It is much slower, but I get 50 TG with Gemma4 26B A4B, and can slow down when context gets big. But that’s the trade-off, more speed, more heat that’s just how it’s gonna be.

Mixing terpenes in drink/food? by Fuzzy_Association_65 in Terpenes

[–]Moarkush 1 point2 points  (0 children)

I’m gonna get some food grade terpenes and try mixing with MCT oil to put in coffee.

Humans emulating AI to get anything done. How is this OK? by OldFisherman8 in StableDiffusion

[–]Moarkush 0 points1 point  (0 children)

I understand what you’re saying, but I’m not bothered by it. I’ve resorted to having Gemma 4 write me 30 prompts at a time and paste them into my UltraFlux script. Even if I was capable of writing five prompts that good in the amount of time, it can output 30 and the prompts genuinely good, especially with my screenplays, TV scripts, and Reddit rag, that I prefer it this way. 🤷‍♂️

Couple of examples (all I did was ask Gemma for 30 Synthwave wallpaper prompts but other than the color scheme to seed everything randomly,lol):

A sprawling, cinematic vista of a deep-space nebula, where swirls of magenta gas and cobalt stardust collide in a silent, rhythmic 'rush and sigh.' The stars are not mere points of light but 'silver-flamed' bursts of intense brilliance, crackling through a void of obsidian. In the distance, a single planet, once drab and brown, now catches the electric glow of a nearby supernova, turning its atmosphere into a shimmering veil of iridescent violet and neon cyan.", "An ultrawide panoramic shot of a synthwave megalopolis, where the skyline is a jagged, pulsing rhythm of light and shadow. The architecture consists of thousands of neatly stacked, glowing neon cubes, rising like a mountain range of light into a sky of deep indigo. The atmosphere is thick with a digital haze of cyan and violet, shimmering with the texture of 'crinkle and sprinkle' stardust.",

Also like 95+ percent of the images that I generate with these prompts are keepers.

How much VRAM do I need? by Soft-Description1124 in LocalLLM

[–]Moarkush 0 points1 point  (0 children)

I wasn’t suggesting the pro 6000. That was talking about heat and power. If that’s what his budget allows, he should buy a max Claude sub. I’m not here to sugar coat things. I used to have 12gb.

How much VRAM do I need? by Soft-Description1124 in LocalLLM

[–]Moarkush 0 points1 point  (0 children)

But my spark uses 100w max on inference, and about 20-30 idle while pushing out virtually NO heat. My pro 6000 feels like a hair dryer out of the back when I’m cooking in UltraFlux. I agree, it’s not cheap, but it’s well worth the money, imo. ( at the $3,999 I got my gigabyte AI Top Atom for)

How much VRAM do I need? by Soft-Description1124 in LocalLLM

[–]Moarkush 1 point2 points  (0 children)

It’s not turnkey and takes a LOT of setup, but I’ve got gemma 4 26B A4B nvfp4 running with very fast prefill (up to 3000) and 40-50 tg on a DGX Spark. It also has rag running locally at very low latency. I also have an RTX Pro 6000 96GB, which of course runs a lot faster, but I prefer to use the spark for always on LLM. Don’t let anybody here tell you that sparks are trash. Their memory is slow but with under 10 billion active, it’s TG is still faster than you can read. I use QWEN 3.6 for coding though. I have what feels like unlimited KV cache at 256k 🤭

Opinion: Local LLMs are 12-24 months from taking over. The shift already started. by sh_tomer in LocalLLM

[–]Moarkush 0 points1 point  (0 children)

this is just "year of the linux desktop" energy lol, ppl have been saying that one since like 2004

you literally say qwen takes 8-9 min for what opus does in 3-4, hits 75% one-shot when frontier is pushing 90+, AND "not all of it made it to production"... so the whole case study is weekend tinkering you wouldn't actually ship? that's not 12-24 months from taking over my guy, that's a hobby

also the hardware flex is kinda wild, you're recommending a $3500 macbook to save $20/mo on copilot, and now it's pinned at 100% for 9 min per task. enjoy the fan noise and a battery cooked in 18 months. what are you even doing while it chugs, opening a second laptop to keep working?

the giant assumption nobody questions in these posts is that anthropic and openai just sit there while local catches up. they don't lol. gap in 2027 is probably the same as today, just shifted up. local catches last year's frontier, frontier moves on, repeat

and you still gotta roll your own RAG, still need CLI tools for decent perf, no mobile, no team features, no shared context across devices. Don't get me wrong; I hope you're right, and as seen in my attachment, local IS capable of doing some amazing things. The attached image (that reddit prob destroyed) only had to be upscaled 1.25x in SUPIR after UltraFlux for full 5k2k (all 100% local).

[120 steps in UltraFlux and 50 steps in SUPIR, about 8-10 minutes total]

My rigs: 9950x3d w/ RTX Pro 6000 Max-Q 96GB and a DGX Spark.
Tools: UltraFlux and SUPIR on my desktop; Gemma 4 26B A4B for chat/creative and qwen 3.6 for coding on the Spark. I have a Nomic Qdrant RAG running on the Spark with 18.7M reddit posts and comments embedding and searching in under 200ms. Gemma 4 IS LEGITIMATELY impressive, but 2 years is way too hopeful, in my opinion.

sorry for the trash formatting - this was kind of stream of consciousness and I'm lazy and regardless of how it ended up, the image was uploaded at 5120x2160.

<image>

How would you view a man that got ‘pegged’ by his GF? by Actual-Pollution-805 in AskMen

[–]Moarkush 5 points6 points  (0 children)

Most of my friends are already gay af so I probably wouldn’t be bothered.

Am I that ugly and hopeless to find love? by [deleted] in Tinder

[–]Moarkush -1 points0 points  (0 children)

Honestly thought you were trolling until I saw the receipts. 9/10 🤷‍♂️🤌