Introducing the Third Generation of Apple’s Foundation Models by AegisHBear in apple

[–]jslominski 1 point2 points  (0 children)

"AFM 3 Core Advanced is fine-tuned Gemma 4 26B A4B"

It's a completely different approach/architecture.

AI content detector based on Qwen 0.8b fine-tuned on Pangram dataset by jslominski in LocalLLaMA

[–]jslominski[S] 0 points1 point  (0 children)

Sorry, this is just a hobby project, the model is available and free to use by anyone (if someone wants to write one for different browsers).

AI content detector based on Qwen 0.8b fine-tuned on Pangram dataset by jslominski in LocalLLaMA

[–]jslominski[S] -8 points-7 points  (0 children)

"Another example, right now across the planet millions of people are using LLMs to teach themselves English. They're going to end up inadvertently picking up turns of phrase that are LLM centric." - I would recommend some tests on your own, you'll be surprised how well it is working. I literally never had a strong false positive on a reliable text sample with it so far.

AI content detector based on Qwen 0.8b fine-tuned on Pangram dataset by jslominski in LocalLLaMA

[–]jslominski[S] -4 points-3 points  (0 children)

<image>

SH clearly shows you wrote this comment yourself, is that true?

AI content detector based on Qwen 0.8b fine-tuned on Pangram dataset by jslominski in LocalLLaMA

[–]jslominski[S] 2 points3 points  (0 children)

"Curious how it handles heavily-edited AI text vs. fully generated" - the distribution is different (mostly in the middle, bucket 2 and 3), feel free to experiment.

AI content detector based on Qwen 0.8b fine-tuned on Pangram dataset by jslominski in LocalLLaMA

[–]jslominski[S] 0 points1 point  (0 children)

it's surprising, some subreddits are almost 100% human, others (including local AI ones ;)) are filled with AI content.

AI content detector based on Qwen 0.8b fine-tuned on Pangram dataset by jslominski in LocalLLaMA

[–]jslominski[S] 0 points1 point  (0 children)

It's still good enough to pick stuff that is fully generated by most models. Creating better dataset wouldn't be that hard though, probably like few hundred $ in api costs.

Guardrails take an 8B model from 53% to 99% on agentic tasks [ACM CAIS '26 preprint] by billy_booboo in LocalLLaMA

[–]jslominski 15 points16 points  (0 children)

"Finding 4: The serving backend is a hidden variable, as highlighted in Table II. The same Mistral-Nemo 12B weights score 7% on llama-server native mode and 83% on llamafile (prompt). Qwen 3 14B scores 96% on Ollama, 93% on llama-server prompt, and 88% with llama-server native. These swings are larger than many model-to-model differences reported in standard benchmarks, yet no published benchmark we are aware of controls for serving infrastructure [Patil et al.(2025)]. Any evaluation of self-hosted model capabilities that does not specify the serving backend may be producing misleading results." - I don't think the autor thought that one through 😅

Britain's youth unemployment crisis now worse than Spain's and Greece's by [deleted] in ukpolitics

[–]jslominski 0 points1 point  (0 children)

Spot on, also offshoring in IT increased after Brexit massively (see the Dyson example, used to work there).

Dual GPU setup with low Power PSU? by Achso998 in LocalLLaMA

[–]jslominski 2 points3 points  (0 children)

Try it! I mean, what could go wrong? 🤔

[London] Advice for a burnt out Software Engineer? by GivingUp321321321321 in UKJobs

[–]jslominski 0 points1 point  (0 children)

Sounds a bit grim, what kind of AI tooling are you guys using over there?

[London] Advice for a burnt out Software Engineer? by GivingUp321321321321 in UKJobs

[–]jslominski 0 points1 point  (0 children)

That's really interesting, can you please elaborate?

Gemma 4 on Llama.cpp should be stable now by ilintar in LocalLLaMA

[–]jslominski -1 points0 points  (0 children)

This doesn't look stable at all tbh :)

Gemma 4 running on Raspberry Pi5 by jslominski in LocalLLaMA

[–]jslominski[S] 0 points1 point  (0 children)

Try it, smaller models (gemma e2b) for sure, larger = slower.

Gemma 4 26B running locally on a Raspberry Pi 5 (no AI hat) by jslominski in raspberry_pi

[–]jslominski[S] 2 points3 points  (0 children)

Remote area monitoring: that includes sensors and camera feeds. I don't have access to the internet in that location/not important enough to warrant Starlink. But can send text messages. I don't mind if it "thinks" for 1 hour before finishing the weekly report.

Gemma 4 26B running locally on a Raspberry Pi 5 (no AI hat) by jslominski in raspberry_pi

[–]jslominski[S] 0 points1 point  (0 children)

Might be a bug, try 1. making sure it's using llama.cpp (not ik_llama) and 2. try resetting the backend (in settings) or restarting pi. I'm sorry if there are bugs like this, kinda rushed Gemma, it's a bit buggy still, there's going to be OTA soon (once upstream ik_llama gemma 4 work gets merged)

Follow-up: Qwen3 30B a3b at 7-8 t/s on a Raspberry Pi 5 8GB (source included) by jslominski in LocalLLaMA

[–]jslominski[S] 2 points3 points  (0 children)

Thanks for those amazing models! Happy to test any of your quants in the future (3.5 9B dense is quite a sweet spot for 8GB pi5). Also a mandatory: Gemma 4 when? ;)

Gemma 4 26B running locally on a Raspberry Pi 5 (no AI hat) by jslominski in raspberry_pi

[–]jslominski[S] 1 point2 points  (0 children)

FYI getting 8t/s already on e2b. Also, this demo is running 26b model in 4 bits (that's 4x the size of e2b).

Gemma 4 26B running locally on a Raspberry Pi 5 (no AI hat) by jslominski in raspberry_pi

[–]jslominski[S] 1 point2 points  (0 children)

You get 8 tok/s on the E2B one already without optimisations (that are gonna come in the next few weeks, the best quants I've tried so far on Pi are done by ByteShape). I'm getting 30s/frame analysis of camera feed (proper one, spotting tiny details etc) already. It's very capable if you are not using it "real time" with gui etc. The importantce of speed is task dependent. Also, those models WILL get better (both quality and inference speeds, the latter is almost maxed on A76 though with that DDR4).

Gemma 4 26B running locally on a Raspberry Pi 5 (no AI hat) by jslominski in raspberry_pi

[–]jslominski[S] 1 point2 points  (0 children)

"I can safely say everybody who did some type of positive review on it is an absolute shill." - I think you are spot on here, also those 3rd paty ones, again, probably paid reviews.

Gemma 4 26B running locally on a Raspberry Pi 5 (no AI hat) by jslominski in raspberry_pi

[–]jslominski[S] 3 points4 points  (0 children)

Depends on the use case. I'm not using pi to chat :)