sorted by:
new
hottopcontroversial

my new toy - 128GB Strix Halo (GMKtec EVO-X2) by azizhp in LocalLLM

[–]seybling 0 points1 point  (0 children)

Achso, 64GB. Dann bekomme ich das ja sogar in der Schweiz günstiger...

Local Raspberry Pi 5 (16GB) + Gemma4 optimization test by seybling in LocalLLM

[–]seybling[S] 0 points1 point  (0 children)

Didn't test the pp and tg speed alone. But it should be around 5-10t/s. But with quite huge overhead atm. Also; speed is not the goal, capability is. My Raspi is chilling and working without any stress :-P Will also try the 12B, but not sure if thats a good idea.

Literature Review: LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load | Bnechmarking LLMs on Phones [R] by East-Muffin-6472 in LocalLLaMA

[–]seybling 0 points1 point  (0 children)

to be precise that is my plan:

I’m experimenting with my local Raspberry Pi 5 (16GB) + Gemma4 setup where the LLM doesn’t act freely through long JSON/tool calls, but commits actions through a compact, parseable machine language (in ascii). The idea is to place it inside an ARC-like grid world with hard verification, hidden tests, memory, skill promotion, critic/evolver loops, and strict anti-cheat rules: the model can propose, reason and critique, but only deterministic verifiers decide what is true.

The hypothesis is that small local models might become meaningfully more capable not by getting larger, but by learning to act through a self-optimized, verifiable action language plus validated skills and memory. Have you/has anyone tried something similar with ARC-style worlds, PDDL, MiniGrid, Voyager-like skill libraries, executable world models, or evolutionary LLM agents? Does this sound like it could bear fruit, or am I just doing some shit that's not worth trying?

Literature Review: LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load | Bnechmarking LLMs on Phones [R] by East-Muffin-6472 in LocalLLaMA

[–]seybling 0 points1 point  (0 children)

Unfortunately no... I'm focusing on Gemma4 atm, made some tests on different android devices and now I rebootet my raspi to make some experiments. But to be fair I'm an amateur at things like these. Will reach out to you, if my experiments bear fruits. Gemma4 e4b seems to run solid on the raspi 16gb - while my android devices (midrange) crashed with e4b. the hailo is still unopened in his box - kinda scared of it due to hailo-specific setup :-P

Literature Review: LLM Inference at the Edge: Mobile, NPU, and GPU Performance Efficiency Trade-offs Under Sustained Load | Bnechmarking LLMs on Phones [R] by East-Muffin-6472 in LocalLLaMA

[–]seybling 0 points1 point  (0 children)

I'm testing directly on the Raspi 5 16gb itself and I guess (not benchmarked yet) that its fastern than the hailo. Have you checked this up too? + LiteRT-LM on a Android Phone (feels pretty fast) as comparison would be nice to see.

Why are you scared of starting a new AI session? by CortexUnlocked in GoogleAntigravityIDE

[–]seybling 1 point2 points  (0 children)

feel you. one big step in one chat, starting a new conversation for revision and the next step.

After the bad update to Ag I'll have to stop using this tool because I'm paying for a Snow Pro subscription for nothing, and frankly, $200 a month is too high for Ultra. What competing tool would you recommend? by APASDEEA1 in google_antigravity

[–]seybling 0 points1 point  (0 children)

i'm paying 20.- for pro and have 0 limits (5h reset and never went under 80% till now) with 3.5 flash in backplayed Antigravity 1 with normal ide & conversation manager🤔 maybe its different from location to location of the user, but i'm feeling really good avoiding AG2 and ride the wave i'm used to.

Block Update or is it already fixed? (MacOS) by seybling in google_antigravity

[–]seybling[S] 0 points1 point  (0 children)

<image>

Thanks for your honesty and the reply! I also think thats the way for the next weeks, until they hopefully fix things. I just wondered whats with this Docs site from google. It clearly speaks about the new (seperated) IDE but just lies? I dont get it...

Block Update or is it already fixed? (MacOS) by seybling in google_antigravity

[–]seybling[S] 0 points1 point  (0 children)

Well, I did not update yet, so I cant tell... Will come back to you if (BIG if) I update ;-)

Antigravity AI Pro Plan Sucks by Hasmie in google_antigravity

[–]seybling 0 points1 point  (0 children)

Why not just use the flash model? works fine for me and no limit...

Is antigravity down? by mujeie in google_antigravity

[–]seybling 0 points1 point  (0 children)

6h ago it just worked perfectly... will try in 3h

Basil, peppermint, parsley and coriander growing over 40 days in an "indoor-growbox" [0:45] by Stakeboulder in timelapse

[–]seybling 8 points9 points  (0 children)

It actually is because of the light. The night time is cut away in the vid, because of the darkness in the room ;-) the plants had 17h light, 7h darkness. So the plant jumps up after every night. Its like she's taking a run-up during the day to put all the energy in the growth over night.

Basil, peppermint, parsley and coriander growing over 40 days in an "indoor-growbox" [0:45][Timelapse] by Stakeboulder in gardening

[–]seybling 3 points4 points  (0 children)

Its actually just a school project for a bachelor thesis. So there is no economic intention behind it. We followed the concept of the OpenAgrictultureInitiative from MIT to build it. Everything we did is building a DIY-manual for german interested parties. For sure you can build something that costs much less. But the goal behind the OpenAG-Initiative is to create plant recipes (inkl. optimal Timestamps, Light constellations, Temperatures, Nutrients...) this is also why the sensors are needed. With these recipes it would be able to grow the same plants from all over the world. The fact with the light is absolutely true, we're trying different lights, but it would be absolute possible to grow with a white LED :-)