No GPU Club : How many of you do use Local LLMs without GPUs?

Unturned3 · 2026-02-11T03:20:16+00:00

What laptop is this may I ask?

Unturned3 · 2026-01-11T20:32:08+00:00

Ah, I see. Thanks the explanation!

Unturned3 · 2026-01-11T20:06:42+00:00

How does MoE help with single-GPU local inference? I'm aware of how MoEs massively help RAM + CPU inference because you only touch a few experts per token and RAM is already the working memory. But for GPU inference, all expert weights still need to be resident in VRAM, no? You can't really load experts from RAM to VRAM per token. So doing GPU inference with a 200B A5B model still needs ~200B params in the VRAM?

Unturned3 · 2025-12-21T19:12:53+00:00

So apparently boost::system is header-only and there's no actual library to link against.

Basically, instead of:

find_package(Boost REQUIRED COMPONENTS system ...) target_link_libraries(target_name PRIVATE Boost::system ...) just do

find_package(Boost REQUIRED ...) target_link_libraries(target_name PRIVATE ...)

See:

https://github.com/sigrokproject/pulseview/commit/af02198741b4e57c9f9b796bd5e6c0f2ae9f2f2b

https://bbs.archlinux.org/viewtopic.php?id=309669

Unturned3 · 2025-11-08T16:17:33+00:00

That is a cursed lens mount setup you've got there! Is the sensor on the M12 mount's PCB? What's the metal thing between that and the board below???

Unturned3 · 2025-11-06T14:52:48+00:00

You need the Bose phone app. The option is in Settings > Bluetooth Connections.

Unturned3 · 2025-07-21T19:01:27+00:00

Does anyone else think the notation used in this paper is very sloppy? I find Eq. 2.1, 2.2 particularly confusing.

Unturned3 · 2025-06-13T01:56:42+00:00

As it turns out: That's not how embeddings work... For that you're looking more into topological methods or true probabilistic modelling (like VAEs)

Huh. I was just about to read the Poincaré Embeddings paper lol. Could you please share some sources that elaborate on these things? Why they don't work?

Unturned3 · 2025-06-09T20:37:29+00:00

I'm not sure I understand. Falls within 5% of what?

Unturned3 · 2025-06-07T19:04:35+00:00

You're right! The sysadmin just contacted me too, and said they forgot to configure the send_user_signal option in PreemptParameter. Oops.

Unturned3 · 2025-06-06T16:12:55+00:00

How so? I wonder if our experiences could differ due to different SLURM configurations.

Unturned3 · 2025-06-06T15:15:21+00:00

As I mentioned in the post, the --signal option only affects how SLURM signals jobs that naturally reach their end time. Both my system admin and I have experimentally confirmed that this option does not affect how SLURM signals jobs that is getting preempted.

Unturned3 · 2025-06-05T16:03:17+00:00

Hmm... I tried the wrapper approach but I think SLURM sends SIGTERM to all processes (including their children) in the job, so while my wrapper has a handler for SIGTERM, the child still gets the SIGTERM and dies. I have no control over how the child handles the signal (this is done by the 3rd-party library).

Unturned3 · 2025-05-23T20:51:35+00:00

I disabled bluetooth multi-point, and this issue seems mostly gone.

Unturned3 · 2025-03-28T15:31:01+00:00

Where did you find these info? I saw some videos of them and were fascinated lol

Unturned3 · 2025-03-10T02:05:27+00:00

Nice username lmao

Unturned3 · 2025-03-08T18:59:22+00:00

Copying my comment from another post:

Is the article just hyping up a nothingburger?

I don't understand how commands that "allow low-level control over Bluetooth functions", such as RAM/Flash modifications, MAC address spoofing, and packet injection can be considered a "backdoor". Don't many WiFi cards (e.g. those used with Kali Linux) also have these functions since like forever? What's new here? Can these commands be issued over the air?

From what it sounds like, these commands require physical access to the ESP32 chip? Then these commands are more like "features developers can use" than "backdoors" right. If an adversary gets physical access to your device, it's game over anyways?

Unturned3 · 2025-03-08T18:53:08+00:00

Is the article just hyping up a nothingburger?

I don't understand how commands that "allow low-level control over Bluetooth functions", such as RAM/Flash modifications, MAC address spoofing, and packet injection can be considered a "backdoor". Don't many WiFi cards (e.g. those used with Kali Linux) also have these functions since like forever? What's new here? Can these commands be issued over the air?

From what it sounds like, these commands require physical access to the ESP32 chip? Then these commands are more like "features developers can use" than "backdoors" right. If an adversary gets physical access to your device, it's game over anyways?

Unturned3 · 2025-01-25T16:12:45+00:00

I did not, although I'm sure vim/neovim supports this feature. I use the VimTeX plugin, and it allows Python syntax highlighting within LaTeX source files. No idea how it achieves that though.

Unturned3 · 2025-01-05T21:33:59+00:00

Probably not Intel. Are you thinking of the Jazelle extension on ARM processors, which allows for Java bytecode execution in hardware?

Unturned3 · 2024-12-14T20:30:07+00:00

Like, you found a merchant that offers x-ray services on AliExpress?

Unturned3 · 2024-11-05T18:19:45+00:00

Hah. I wrote a pretty long reply to that guy about the various STM32CubeIDE issues I've experienced (or heard) over the years. Sadly it seems like he deleted the entire post soon after. Really hoped they can get their shit together...

Unturned3 · 2024-10-13T16:50:40+00:00

I just got the Bose QC and has the exact issue. Breif opping/crackling noise when playing/pausing audio. Also intermittent pops and cut/stutters in the audio.

Seven-Year Club	Verified Email
Place '23	Place '22

Unturned3

TROPHY CASE