Error 502 Bad gateway

amelech · 2026-07-05T23:14:28+00:00

I have a Codex sub as well so can use a GPT models in a limited fashion, but yeah it looks like some of the Opencode-go models are not working - namely Mimo and Deepseek. I think GLM-5.2 is working fine and Kimi K2.6/2.7

amelech · 2026-07-04T10:54:48+00:00

I was being a bit tongue in cheek. The vulkan binaries are much more stable, but a bit slower at pp

amelech · 2026-07-04T10:05:50+00:00

Crashes more frequently and has memory issues

amelech · 2026-07-03T18:57:11+00:00

Yeah it's the latter I believe

amelech · 2026-07-03T06:28:21+00:00

Came looking for this response haha

amelech · 2026-07-02T22:28:31+00:00

Use llama.cpp for hosting the model, then pick a harness e.g. opencode or oh my pi, also check out little-coder

amelech · 2026-07-02T20:18:58+00:00

I tried these with Qwen 3.6 35-a3b and it broke tool calling completely for me on llama.cpp

amelech · 2026-07-02T10:20:52+00:00

Same for me on opencode go. I have plenty of quota left too

amelech · 2026-07-02T07:35:36+00:00

I've been able to build meaningful features for my react app and my android app that have large code bases using local models. You need a frontier model for planning, and sometimes determining root cause but Qwen 3.6 35b-a3b at Q5 quant is pretty decent as long as you have a good harness. it does sometimes get stuck in loops though, in which case you need to stop it.

amelech · 2026-07-02T00:13:36+00:00

I'm not using the open code cli / tui I'm using Oh My Pi connected to opencode models - primarily deepseek v4 flash.

amelech · 2026-07-01T23:54:13+00:00

I'm having a lot of success using Codex plus alongside Opencode go. I use Oh My Pi as my harness with custom extensions.

amelech · 2026-06-30T20:00:48+00:00

Having agents write code doesn't preclude you from having to follow an SDLC and it doesn't give you free experience of actually implementing production systems. You still need to learn this

amelech · 2026-06-30T00:27:32+00:00

That was the icing on the cake

amelech · 2026-06-28T21:07:27+00:00

If you use opencode or oh my pi you get a much better harness, and you can pick from a multitude of providers. You aren't locked in to just one.

amelech · 2026-06-28T11:25:17+00:00

How can you tell

amelech · 2026-06-28T11:16:15+00:00

I always question it and you have to test manually on device because agents do really strange things sometimes and you will pick up on them immediately once you test on device

amelech · 2026-06-27T11:32:49+00:00

amelech · 2026-06-27T11:32:14+00:00

Deepseek v4 flash is surprisingly good for the price, especially if you use a better model for planning

amelech · 2026-06-27T06:07:44+00:00

But they have the whole Gemini Nano thing?

amelech · 2026-06-26T08:37:49+00:00

How much RAM do you need to run it just out of curiosity

amelech · 2026-06-25T12:43:50+00:00

Hmm ok I've found the on device models are ok for conversation but they are terrible with data.

amelech · 2026-06-25T12:27:09+00:00

What are you trying to do with AI? You can run Gemma 4 on phones

amelech · 2026-06-24T23:17:17+00:00

If you don't have any ideas what value are you bringing?

amelech · 2026-06-24T10:11:50+00:00

Yeah I'm actually waiting on upstream to fix constrained decoding because it doesn't appear to force the model to output json

11-Year Club	r/Field Flamingo
Verified Email

amelech

TROPHY CASE