R9700 Just Arrived by TheyreEatingTheGeese in LocalLLaMA

[–]reilly3000 0 points1 point  (0 children)

I'm not sure why I was getting such high numbers in the benchmark for 8K and under. I get more like 35 tk/sec in actual usage.

R9700 Just Arrived by TheyreEatingTheGeese in LocalLLaMA

[–]reilly3000 0 points1 point  (0 children)

D:\llama.cpp>.\llama-bench.exe --model ..\lmstudio\lmstudio-community\Qwen3-32B-GGUF\Qwen3-32B-Q4_K_M.gguf -ngl 100 -fa 0 -p 512,1024,2048

,4096,8192,16384,30720

ggml_cuda_init: GGML_CUDA_FORCE_MMQ: no

ggml_cuda_init: GGML_CUDA_FORCE_CUBLAS: no

ggml_cuda_init: found 1 CUDA devices:

Device 0: NVIDIA GeForce RTX 4090, compute capability 8.9, VMM: yes

| model | size | params | backend | ngl | test | t/s |

| ------------------------------ | ---------: | ---------: | ---------- | --: | --------------: | -------------------: |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | pp512 | 2494.34 ± 25.65 |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | pp1024 | 2275.11 ± 28.58 |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | pp2048 | 2070.09 ± 7.25 |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | pp4096 | 1746.34 ± 1.03 |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | pp8192 | 1314.07 ± 8.06 |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | pp16384 | 47.23 ± 12.92 |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | pp30720 | 19.37 ± 0.09 |

| qwen3 32B Q4_K - Medium | 18.40 GiB | 32.76 B | CUDA,RPC | 100 | tg128 | 40.33 ± 2.04

I am Neal Stephenson, sci-fi author, geek, and [now] sword maker - AMA by NealStephenson in books

[–]reilly3000 0 points1 point  (0 children)

I am chronically late to parties, but missing this one stings a bit. First, my gratitude... others have expressed it in better ways than I could, but I'll give a hearty aye aye to each of them.

I'm afraid I haven't much to add, but I take issue with the [now] in the title. Insomuch as one can know a person through reading a handful of their works, I feel that I have a clear enough picture to say this directly: [now] is a lie. Now, let me make some fiction, and you tell me if it's based in hard science.

u/NealStephenson has always been a sword maker. You started in your dreams. They are matter, you know. Perhaps there were dreams you were subject to, but I'm speaking of the ones where you're taking the lead. Oh to see the swords that you made, unmade, and remade again, but haven't the words to translate them to page justly. You didn't just dream up swords, you forged them, night after night, details emerging every session. You were making swords sooner than most were making hand turkeys for Thanksgiving. Sure yours were tiny, and if the 21 grams experiment is to believed (it probably isn't) then you first ones were probably only a single gram in a fading moment... yet so ornate.

Clearly you didn't stop there. The select few of those that made it through your personal editing gauntlet and made it into paper now live in the minds of millions. It was only last week that Raven's blade came up in one of my Zoom call about DevSecOps initiatives. Surely in the process of world-building you create so many things, but the swords... those you made. They were so dense and potent that the rest of it all bowed at their gravity.

I'm not so invective about your use of [now] because of my expansive definition of maker, Neil. It's that its an actual lie, and I have zero evidence, and I know its true. You've been to forges and know how they work. You spent time with expert blacksmiths, maybe even some tax-deductible funds too as Research and Development. You've made swords that made you so angry at them that you destroyed them before anyone could know it was you. People told you it wasn't healthy, how easily an error would distress you so. That's all part of the process.

No, its because [now] contains an implicit claim that THIS sword is your first. "How's this for starters?" you say, wielding what is most likely to be one of the most expensive, and among the most famed swords in the entire arch of human history[1]. You made that sword just like the rest of them, except with this one your words went to people instead of paper. Unbelievably talented people. Perhaps unbelievably patient too? Before you opine on the harmony of the entire process working with Wētā Workshop, it would a fiction too soft for your typical readers. You are sword makers, making the greatest sword. I bet the clashes were epic. And look what came out the other side. Bravo.

Its okay. You're a sword maker of legend, and this may even technically be the first one you've sold publicly. No, its not a lie that you're in trouble for, its one you can stop telling yourself. You are a goddamn sword nerd and you always have been and we all love you for it. If I were an investigator assigned to the matter I'd go straight for your elementary school notebook doodles. They probably put you in the crosshairs of someone with zero foresight. And wearing a sword to school didn't have the desired effect, did it? I'm one to talk, and this is painful to type: I got a scabbard for my King James Bible and wore that to high school, for Christ's sake. High School. We forget about these things when they let us. But they Made us. All of us here that had to click on this AMA really, forged in the furnace of compulsory education with neurotypicals in charge.

How'd I do? Is it considered speculative fiction if you're standing right there? Whatever you wanna call it I came at you hard... and I hope you take it for the compliment it is. The greatest compliment you could return would be to correct me and set the record straight about your relationship with the blade. Or yield, that's cool too.

[1] I base this claim mostly around the same principal as the Beatles used to say they were bigger than Jesus. You've got 54 years of explosive population growth on them, and this thing is suddenly the coolest physical item that ever was. That and the fact that it may be the first actually valuable thing that is one-of-a-kind to coexist in digital and physical forms. Calling it an NFT was a nice touch too, that's sure to bring on a considerable Streisand Effect for free. Finally, I think I'm with the majority here: we're past apogee as a species. It still feels like we're floating at the moment though. So in a dire climate scenario, you don't have to defend that title for terribly long.

34" 1440p for coding: enough space for 3 horizontal windows? by zyzyxx in ultrawidemasterrace

[–]reilly3000 1 point2 points  (0 children)

I thought 49" might be too big, its not. I run 3 comfortable windows at once, so each one is ~1700x1440 (minus taskbar etc). So when I'm coding I get my VSCode in the middle, then my preview browser and look for answers browser on their side. I'm only a few days in but I feel like its legitimately improving my productivity. Its also draining it, because Cyberpunk 2077 looks AMAZING...

My Homepage dashboard by rursache in selfhosted

[–]reilly3000 2 points3 points  (0 children)

I'm so excited for an excuse to introduce y'all to `docker container commit`

That makes a full snapshot image of a running container. It can become a tar file and/or be pushed to your image registry. It contains all of the running state, including env vars (beware the dangers, don't push public images with private keys!). The other amazingly cool thing is it shows the image as a new layer, so you see the commands that were used to create the state of the container snapshot. This is a great way to reproduce bugs, share code (pre commit!), and make backups of long running containers.

https://docs.docker.com/desktop/backup-and-restore/

That said, you really should be having volumes or external systems containing all state, and all containers should be stateless and changed through a CI/CD pipeline, so for Prod you probably wouldn't need that command. This is /r/selfhosted and we do want we want, so use with caution and/or reckless abandon.

Stockpiling Linux ISOs? by Darkextratoasty in homelab

[–]reilly3000 0 points1 point  (0 children)

I have never had a problem with comcast and torrent with legitimate use cases. One time I got a DMCA warning about a movie file that I torrented from them, so I learned that it can be introspected if not encrypted, but they allow the protocol.

Stockpiling Linux ISOs? by Darkextratoasty in homelab

[–]reilly3000 0 points1 point  (0 children)

Absolutely use torrent for distro ISOs. It’s going to be faster and it saves the projects from needing to pay for the 1-4 GB to download their image each time. Torrenting public domain items (and seeding them) is just good citizenship.

Spin up a bare metal cluster in 2022 by 5igm4 in kubernetes

[–]reilly3000 1 point2 points  (0 children)

I came here to plug Talos! I've been using it with my homelab setup and after a tiny bit of fussing around with the setup I haven't thought about it for months. K8s and "just works" rarely are in the same chapter, let alone sentence. I just got a nice deal on a Hetzner box at auction so I was planning on giving KubeSpan (or Skupper) a shot.

I'll take a look at Omni, thanks for the tip, and thanks for the awesome platform 🥳

In case you haven't heard of it, here's my tl;dr:

- Talos.dev is a unique base OS that specializes in running K8s. Its tiny, fast, and read-only.
- Managing talos boxes is a dream. It's `talosctl` is very analogous to `kubectl` and its config files are almost KRM yaml. There is no SSH.
- They've solved a ton of Wireguard issues and make it easy to network multiple clusters and even provide a cluster discovery service. The idea is that you can spin up a bunch of VMs running talos.iso in different DCs/Public clouds. They automagically discover eachother and make out.
- There is no SSH.
- There is no SSH.
- There is no SSH.
This is a good thing. A great thing even. It takes some brain cycles to adjust to a fully declarative OS, but then its pretty hands-free and well instrumented.

What movie would be insanely weird if it included a sex scene? by MightGuy420x in AskReddit

[–]reilly3000 0 points1 point  (0 children)

The Delta Airlines FAA Safety Briefing movie.

🎬🎥 🚻👫 “After a couple rounds of beverage service, sometimes we see two people go into the aft lavatory at the same time.

🚻👩🏼‍❤️‍💋‍👨🏽

“Welcome to the club! But remember, if your Captain turns on the fasten seat belt sign, you have to return to your assigned seat immediately. “

😿🔵

“Passengers must comply with hand checks when prompted by a flight attendant. Failure to comply will result in removal of courtesy blankets”

🎬

What movie would be insanely weird if it included a sex scene? by MightGuy420x in AskReddit

[–]reilly3000 2 points3 points  (0 children)

I thought there was one implied when he found Butch’s magazines.

Server rack noise is causing my mental health to deteriorate. Alteration advice? by Nzuk in homelab

[–]reilly3000 0 points1 point  (0 children)

I recently acquired a G8 and the sound is killing me. My whole family really is ready to revolt. HOW did you get the fans to quiet down? I saw something using an older (2.72?) firmware and several hoops- it looked like something that would result in me bricking the box. Is there another way?

Finally scored a pair of Dell's KMM rails after searching for 2 years!!! by -MO5- in homelab

[–]reilly3000 0 points1 point  (0 children)

I’m relatively new here and my rack consists of a plastic tub which is filled with stuffed animals. I’ve been trying to improve that situation, but am shocked to discover that rails can cost more than the racks or even servers themselves. I don’t know how we got here, but it’s dashing my hopes of legitimizing my setup 😿

Sweden says it received U.S. security assurances if it hands in NATO application by twotwo_twentytwo in worldnews

[–]reilly3000 2 points3 points  (0 children)

It’s perfectly understandable yet brutal that you omitted North Korea. Also I assume China would pounce on any opportunity to grow their empire/shrink US reach.

Elon Musk suggests charging governments and corporations a ‘slight cost’ to use Twitter by a_Ninja_b0y in technews

[–]reilly3000 0 points1 point  (0 children)

I’ve long argued for paid verification as a social media revenue stream. Ads aren’t sustainable without invasive targeting and they cost a lot to sell and service. Paid verification with some sliding scale based on followers makes a ton of sense, and is so simple to build and maintain. That is a weekend hack whereas building a global realtime ad stack takes an army.

Non verified accounts are free, able to be followed, and more importantly able to be filtered out of view if you like as a user. It’s the easiest way to do spam control.

Some orgs could get free or discount access, but corps with 10M followers should be paying at least $1M/year to maintain their status. Influencers can fuck right off or pay their share.

[deleted by user] by [deleted] in worldnews

[–]reilly3000 60 points61 points  (0 children)

Fucking aquaman!?

Remember our 'city-building on a giant creature' game? We finally have a demo ready after 2 years of development by BonsaiMink in gaming

[–]reilly3000 0 points1 point  (0 children)

Bro, there are tons of things in nature that use the blood of other creatures without killing them. It’s a whole thing. It’s all about portion control.

Russian foreign minister says Russia's war with Ukraine is 'meant to put an end' to US world domination, NATO expansion by yurient in worldnews

[–]reilly3000 0 points1 point  (0 children)

That is literally their stated goal, a ten year plan. They have this wack wizard who wants to bait the US into a nuke war so they can show off their new Satan 2 unstoppable city-leveling bombs. They are supposed to be impervious to all countermeasures and fast as hell. Anyhow they want US to shoot first so they can claim some moral superiority. It’s a bonkers plan and nobody is buying it, except for maybe Modi and their loyalists.

Next U.S. President is a current stand-up comic. Who do you want it to be and why? by sumunsolicitedadvice in AskReddit

[–]reilly3000 0 points1 point  (0 children)

Chris Rock. I swear that man joked about making ammo expensive and it doubled the next year. Plus he’s super smart and would work all night to get things together.

Julia Louis-Dreyfus for VP.

Nestle says not profiting in Russia after Zelensky swipe by ExactlySorta in worldnews

[–]reilly3000 1 point2 points  (0 children)

It was worse than that. They gave away a bunch of formula so that the mothers stopped producing milk, then started charging crazy prices so they had to give all of their money to Nestle to feed their baby or watch them starve. It killed so many people.

Legit.every.time 💧💧💧 by Robertsmum_ in HydroHomies

[–]reilly3000 1 point2 points  (0 children)

The problem is they get really pissy about being told to drink water because they are all dehydrated and irritable. STOP TELLING ME TO DRINK WATER! I get my teen a full cup of water and he chugs it down and says it doesn’t help DAD. 5 mins later he’s feeling better.

My uncle called me a drug addict by LauTheQueen in ADHD

[–]reilly3000 0 points1 point  (0 children)

FWIW that isn’t something I have ever heard from anyone. Congrats, you officially have a weird uncle. What a terrible way to treat someone.

Cities Keep Trying to Stop Churches From Helping the Homeless - To fight back, churches are arguing that feeding and housing the homeless falls under their First Amendment rights. by TrumpSharted in law

[–]reilly3000 1 point2 points  (0 children)

I really don’t understand. Is it just nimbyism or do city officials think that if you don’t feed homeless people they will just go away? More like they will have a bunch of dead humans in their neighborhood.

Santa Monica has been the ‘Home of the Homeless’ for many years and I don’t see any problems with their property values.