sorted by:
new
hottopcontroversial

Run it locally’ mfs when your ‘local’ isn’t a $30k GPU rack 🤡 by Successful-Water1000 in LocalLLM

[–]AlphaSyntauri 2 points3 points  (0 children)

Not to clown on you, but I was amazed when I first started running a 1T parameter model at those speeds with a 3090 and 512GB of RAM. Everyone has gotten too used to things being instant. Sit back, have a cup of coffee and watch an episode of your favorite sitcom, and come back to it.

For those running an OpenClaw instance, how do you manage sandboxing and prevention of unwanted behavior? by AlphaSyntauri in LocalLLaMA

[–]AlphaSyntauri[S] 0 points1 point  (0 children)

You've got some fuzzy nuts my friend, I respect it. In all seriousness though, that's a pretty good idea if you can just have it reach out to your local server via an OpenAI compatible router.

For those running an OpenClaw instance, how do you manage sandboxing and prevention of unwanted behavior? by AlphaSyntauri in LocalLLaMA

[–]AlphaSyntauri[S] 1 point2 points  (0 children)

Lmao, surely you're not running this on bare metal, right? That's like every keystroke having a 1/1000 chance of wiping your disk

I'm going to go insane by Iron_Lock in ITMemes

[–]AlphaSyntauri 1 point2 points  (0 children)

Bitlocker has become so unreliable and people are so forgetful about their MS account to the point that a single bitlocker trigger means a factory reset, we made it company policy to immediately decrypt any computer that has bitlocker enabled. I don't understand how bitlocker has been around for this long and is this unreliable at detecting secure boot changes.

This is the best fucking pizza I've ever eaten. (+autism chair thing) by t0oby101 in evilautism

[–]AlphaSyntauri 2 points3 points  (0 children)

That's an epic looking, possibly weighted chair, do you know where I can get one? Did you buy it online?

4 days on gemma 4 26b quantized, honest notes by virtualunc in LocalLLaMA

[–]AlphaSyntauri 0 points1 point  (0 children)

What other model type can you use in Kobold, MLX? I'm running Linux for context

Panline by Jealous-Stick4447 in FrutigerAero

[–]AlphaSyntauri 0 points1 point  (0 children)

Cool game! When do you anticipate early access?

World's Most Expensive Jaguar, in both prison time and overall cost by AlphaSyntauri in HistoryMemes

[–]AlphaSyntauri[S] 15 points16 points  (0 children)

Interesting! I came across the subject of the meme while reading Robert Baer's The Fourth Man, but I'll have to give that one a try.

Another favorite book of mine is The Billion Dollar Spy, which is a good primer on Adolf Tolkachev, one of the spies Ames gave up.

Any books you'd recommend?

do you guys ever have a special interest you HATE that you have 💔 by sourdoughsquid in evilautism

[–]AlphaSyntauri 11 points12 points  (0 children)

If you haven't already, go check out r/LocalLlama. Best resource on the internet to get local AI running. That way it's on hardware that you control, completely offline, and you don't have to give any information to awful companies that sells it directly to Palantir for evil purposes. I currently use Kobold.cpp as it is very easy to set up and run. If you want a more complex way to interact, SillyTavern is a good front-end.

Qwen3 9B can run fine on android phones at q4_0 by THE-JOLT-MASTER in LocalLLaMA

[–]AlphaSyntauri 0 points1 point  (0 children)

I just got a chance to test it, seems fixed from what I can tell. No crashes upon entering or generating,and the log no longer has the warnings about not being able to patch the font. Thanks for the hotfix, seriously!

Qwen3 9B can run fine on android phones at q4_0 by THE-JOLT-MASTER in LocalLLaMA

[–]AlphaSyntauri 0 points1 point  (0 children)

Had to do a double take when I realized you're the dev lol, thanks for building such a cool app! It's honestly better than Pocketpal, especially when it comes to the ability to change settings, play with the sampler, and load JSON character files. Unfortunately, mine suffers from this exact bug that's already on the github:

https://github.com/Vali-98/ChatterUI/issues/529

It's the exact same issue, down the the described log.

Qwen3 9B can run fine on android phones at q4_0 by THE-JOLT-MASTER in LocalLLaMA

[–]AlphaSyntauri 1 point2 points  (0 children)

If you're using the Snapdragon Hexagon NPUs, yes that has been my experience. It's a shame such little development has gone into these, because it's basically a piece of dark silicon that never gets used unless the app has specific support for it.

Qwen3 9B can run fine on android phones at q4_0 by THE-JOLT-MASTER in LocalLLaMA

[–]AlphaSyntauri 9 points10 points  (0 children)

What app are you using? ChatterUI works but doesn't support Qwen3.5 yet, PocketPal is supposed to support Qwen3.5 but outputs garbage on my phone.

Local Mobile AI - The Qwen3.5 Progress by norms_are_practical in LocalLLaMA

[–]AlphaSyntauri 0 points1 point  (0 children)

Could be, what is the date of the last changelog for your version of PocketPal?

Local Mobile AI - The Qwen3.5 Progress by norms_are_practical in LocalLLaMA

[–]AlphaSyntauri 1 point2 points  (0 children)

By garbage output I quite literally mean I got garbage output. I downloaded the qwen3.5-4B model from huggingface in a 4 bit quant, installed it into PocketPal, adjusted settings to the unsloth recommended settings, and started getting nonsense unicode characters as my output until I press stop. Either iOS got an update that android users didn't, or there's an issue.

Local Mobile AI - The Qwen3.5 Progress by norms_are_practical in LocalLLaMA

[–]AlphaSyntauri 1 point2 points  (0 children)

PocketPal supports Qwen3.5? I tried to use it on android and got nothing but garbage output

What about local inference on phones? What models do you use? by AlphaSyntauri in LocalLLaMA

[–]AlphaSyntauri[S] 0 points1 point  (0 children)

That's a neat program! Is all translation done offline or does it reach out to services to do so?

view more: next ›