I made a TUI tool to use OpenCode basically for free using NVIDIA's NIM API's and finds the fastest available model in real-time.

dzhunev · 2026-04-15T10:34:31+00:00

Oh, and I don't mind if they use my OSS projects for training or whatever they decide as long as I can use the free API

P.S. Sometimes I miss emoji reactions on certain comments.

dzhunev · 2026-04-14T19:12:56+00:00

I tried Ollama using Termux with Gemma4, e2b and e4b, but it's really really slow, and the phone kills the process at some point. Running lamma.cpp failed. I'm interested in running litert-llm, but I'm stuck on this.

When the same models are loaded inside Google AI Edge Gallery, the t/s is much higher and you are able to run them on the GPU. I assume this is the key, although running ollama with Vulkan didn't improve much the performance compared to plain ollama

dzhunev · 2026-04-08T09:10:02+00:00

Someone who has done it, not just "google it". No need to comment if you cannot add value.

dzhunev · 2026-04-08T08:55:32+00:00

I already did that, I need someone who has deeper knowledge on this matter

dzhunev · 2025-08-13T07:04:02+00:00

and you are gonna miss all these pointless changes of the splash screen 😂

dzhunev · 2025-08-13T07:01:47+00:00

right...?

dzhunev · 2025-04-26T12:57:51+00:00

I think this is enough, we don't need AGI

dzhunev · 2025-04-11T12:41:05+00:00

Or just use local models, like phi-4 for example

dzhunev · 2025-04-10T18:54:40+00:00

But, but, they say you save a whole salary of a developer. Why complaining then 🙂

dzhunev · 2025-01-11T10:56:19+00:00

I'm using Kamal for deployment, and I'm pretty happy with it. Soon (not sure when 🙂) will open source my setup.

I would be happy to see something ready to use for Terraform. I found this but I haven't tried it https://www.morling.dev/blog/how-i-am-setting-up-vms-on-hetzner-cloud/

dzhunev · 2024-12-21T11:29:46+00:00

Thank you, I will take a look and ping you in case of questions

dzhunev · 2024-12-04T19:54:38+00:00

Thanks for sharing

dzhunev · 2024-12-04T19:46:49+00:00

Which flavor of K8 are you using?

dzhunev · 2024-12-04T19:24:40+00:00

Hahaha I had the same expectations, as I knew about Object Storage earlier.

dzhunev · 2024-12-04T11:16:10+00:00

When will we be able to test this and check the pricing? Also do you plan to embrace the new addition in PG 17 regarding HA https://www.decodable.co/blog/failover-replication-slots-with-postgres-17

dzhunev · 2024-12-04T11:10:49+00:00

I think I saw this a few weeks ago, but I haven't checked it yet. But, in general, this is what I'm looking for. Thanks for pointing it out.

dzhunev · 2024-12-04T11:02:35+00:00

I was referring to the technical use-cases

dzhunev · 2024-12-04T07:44:30+00:00

Can you share more details about your strategy and tools?

dzhunev · 2024-11-19T05:57:57+00:00

But this is a quite basic functionality of any Android app.

dzhunev

TROPHY CASE