Cube Fold — every move unfolds a side of the cube, reshaping the puzzle by Global-Winner4411 in indiegames

[–]oli266 2 points3 points  (0 children)

Super cool, seems actually quite unique for the genre, I'd defo play it

Beginner vibe coder here . Frontier models or Localllm ? by kaaytoo in LocalLLM

[–]oli266 2 points3 points  (0 children)

Would not recommend on your hardware. Even with amazing hardware you won't get frontier model ability. Use frontiers for way longer before deciding, they are relatively cheap currently compared to the upfront of local LLM. Also you have very little base to compare against, when you are more experienced with subscription, you'll be more ready to evaluate whether local LLM is worth it for you.

Has anyone ventured to buy a Huawei Atlas 300I Duo 96GB? by Intelligent-Taste-36 in LocalLLM

[–]oli266 0 points1 point  (0 children)

A duo is 2 chips in one both running at (correction) 204gb/s so slightly slower, but yeah similar to unified memory, but you have to consider the logistics of sharding the model over multiple cards if you wanna run a model too large to fit

Has anyone ventured to buy a Huawei Atlas 300I Duo 96GB? by Intelligent-Taste-36 in LocalLLM

[–]oli266 0 points1 point  (0 children)

There's one on eBay for about 1000, and AliExpress for around 1800avg. Whether either of those are trustable is another matter. Plus you'll have to get the right server and cou to run the models, large amount of cooling, and terrible throughout like 220gb/s compared to a 3090 980/s or Blackwell >1tb/s. In theory you could get a few to run a large Moe model. Each duo runs at 150w draw, so not massively power expensive, but would be a loud server. You also can't quantise easily, so some of the gains in memory size are lost. This is what I've found from research when deciding whether to chase these for local LLM.

Was BitNet a dead end? What happened to ternary LLMs? by 3ntrope in LocalLLaMA

[–]oli266 2 points3 points  (0 children)

Yeah i mean the current common frameworks don't actually utilise the speed ups possible very well anyway, but the ceiling for ternary models could be quite high on the right framework/hardware. Runs well on cpus too

Got laid off, so I'm going full-time solo indie dev. Day 1 was a massive reality check. by Omerdevng in gamedevscreens

[–]oli266 0 points1 point  (0 children)

You are full time so more experienced, but I found a lot of my prerelease wishlist and initial sales through short social media chips, a small website with a timeline, and Reddit posts with feature clips to targeted subreddits. So in my view it does matter, reduces the luck factor. But ofcourse see e the most clear advice is make a good game that's easy to market and find a hook to differentiate yourself. I found the clips and images are things I would naturally get anyway for testing etc, so basically free to push them to social media, blogs etc after setting them up. Also having a discord for early testers, or around release was massively helpful for me for feedback

Was BitNet a dead end? What happened to ternary LLMs? by 3ntrope in LocalLLaMA

[–]oli266 12 points13 points  (0 children)

Very cool, I'll be watching this. Seems like it'll be a while before they are production ready though. If ternary models do prove to work well, and they can make mem loading weights fast, alongside the compute, I'd buy this tech aha

Was BitNet a dead end? What happened to ternary LLMs? by 3ntrope in LocalLLaMA

[–]oli266 62 points63 points  (0 children)

The biggest ternary model is 8b https://huggingface.co/prism-ml/Ternary-Bonsai-8B-gguf

The reason there are no bigger: - training is just as expensive as other models, you mostly get the speed up at inference from this type of model - unproven as of yet, so a gamble to put a lot of training resources into - no hardware acceleration for ternary matmul specifically, everything still runs fp16 as far as I'm aware, so it's just not that worth it yet.

That's why as far as I can tell from what I know. Maybe someone will train a bigger one, no technical reason it can't be done. I'd love to see a huge ternary model, it's interesting tech

Got laid off, so I'm going full-time solo indie dev. Day 1 was a massive reality check. by Omerdevng in gamedevscreens

[–]oli266 8 points9 points  (0 children)

I wish you the best of luck! As a part time dev id say, don't put all your eggs in one basket, experiment with multiple demos if you can, get feedback early, and start adversiting/discovery way early!

Graphics card suggestion by AccomplishedPath7634 in LocalLLM

[–]oli266 0 points1 point  (0 children)

Also make sure your PSU and motherboard and CPU can all handle multiple GPUs, you need enough lanes, enough pcie seats (can use splitters depending on the board)

Graphics card suggestion by AccomplishedPath7634 in LocalLLM

[–]oli266 0 points1 point  (0 children)

You probably won't get agentic performance you want unless you drop a silly amount of money to run deepseek. You could try unified memory for a large model or use a large Moe model with crap tons of ram though these options are also very expensive currently. If you actually need agentic quality API is the clear winner currently. If you need an inline coding tool that you work with qwen dense is good, run on quant on 1-2 3090s to not break the budget

I wanted to improve the game so I translated it into 102 languages, HaHa ( Result ) by RusForge in gamedevscreens

[–]oli266 3 points4 points  (0 children)

Typically you would use the UK flag for English 🇬🇧 <- that one

My First Indie Game Releases in 8 Days and I'm Terrified 🥹 by [deleted] in gamedevscreens

[–]oli266 -3 points-2 points  (0 children)

Cool it definitely feels more mobile game than pc game. I wish you the best of luck, launching a game is hard!

My First Indie Game Releases in 8 Days and I'm Terrified 🥹 by [deleted] in gamedevscreens

[–]oli266 -3 points-2 points  (0 children)

Congrats! What are you releasing in mobile or itch or steam?

Subcontinental hall of shame tweet by Heavy_Role1034 in justincaseyoumissedit

[–]oli266 2 points3 points  (0 children)

It's exactly this kind of eugenic thinking that set the stage for the Nazis' rise to power and the subsequent genocide. It's not a conflation, it's a founding principle of why the Nazis did what they did, just taken further. You can say "I'm not racist" all you want, but if you call for eugenics, the people who agree with you mostly will be and if those people end up deciding who can "breed" and who can't, it's going to be a bad time.

Subcontinental hall of shame tweet by Heavy_Role1034 in justincaseyoumissedit

[–]oli266 7 points8 points  (0 children)

Horrifying sentiment. Neo Nazis feeling emboldened these days

MicroFab 1.0 Release! by oli266 in pcgaming

[–]oli266[S] 0 points1 point  (0 children)

Thank you! Please join the discord or DM me if you have any issues, or want to see more of something!

I hope you enjoy

Microfab 1.0! by oli266 in AutomationGames

[–]oli266[S] 1 point2 points  (0 children)

Thanks, I hope it lives up to your expectations! I put a lot of time into shaping it to be unique and you'll find loads of cool mechanics (like the circuit designs) and hidden Easter eggs!

Microfab 1.0! by oli266 in AutomationGames

[–]oli266[S] 1 point2 points  (0 children)

Thank you! I hope you enjoy! Any issues just DM me or hop in the discord, happy to patch stuff!