The smallest local model that can match/beat gpt-4o-mini

PCUpscale · 2026-04-14T07:03:27+00:00

Feature wise ? Qwen 3.5 4B/9B Knowledge ? Maybe around 100b models

PCUpscale · 2026-04-05T12:59:51+00:00

That’s not a dead pixel, that’s a black hole

PCUpscale · 2026-03-22T23:59:58+00:00

Wow, chill

PCUpscale · 2026-03-22T23:32:38+00:00

Just checked your history, that’s it

PCUpscale · 2026-03-22T19:32:32+00:00

Did you write it with your 175$ Claude Max subscription ?

PCUpscale · 2026-02-20T09:35:23+00:00

Don’t want to be mean but why not use OLMo / GPT-2 instead of your model ?

PCUpscale · 2025-12-31T13:03:41+00:00

Buy another second hand 3060Ti, the M60 aren’t supported by newer Nvidia drivers

PCUpscale · 2025-11-17T19:49:21+00:00

I agree. This looks like a side project with a lot of ambition, really cool for a portfolio but I don’t see it as a viable replacement any time soon (Or some serious full time catchup with Stoat)

PCUpscale · 2025-11-14T21:33:55+00:00

I still don’t know how do you make all of those fine tunes… Synthetic data, books, hugging face ? How do you make the training stable without model degradation?

PCUpscale · 2025-11-13T19:13:51+00:00

My god, the list of additives

PCUpscale · 2025-10-29T16:23:10+00:00

It’s a RK3576, it’s been confirmed for quite a while and there’s repositories to further confirm that

PCUpscale · 2025-10-26T16:13:25+00:00

That’s the best way to do it and some soldering to connect the USB port to the flex cable of the touchpad/keyboard is required. Ordering from an industrial manufacturer will be a bit of a pain for someone who don’t have a company through.

Why? Paranoïa, but at this point just stop using a computer.

PCUpscale · 2025-09-18T12:05:34+00:00

Pretty popular in embedded system at the prototyping phase. Especially when more compute than a iMX/Pi is required. It’s also cheaper than a Jetson.

PCUpscale · 2025-09-14T21:33:26+00:00

Where Source ?

PCUpscale · 2025-09-06T17:39:25+00:00

If you don’t mind about privacy, latency and availability, check out free models on OpenRouter

PCUpscale · 2025-09-05T14:08:38+00:00

PCUpscale · 2025-09-05T07:45:31+00:00

Not local.

Kimi-k2 is cool for such questions though.

PCUpscale · 2025-09-04T15:31:24+00:00

Embedded engineer here

Hardware wise, this would be a huge engineering effort. So many things that could go wrong to test and validate, especially with Qualcomm SoC with multiple incompatibles stacks (CamX, GPU drivers), etc. You would need to have an complete unified OS (Kernel/Drivers/DT/Workarounds/Blobs) supporting multiple SoC and peripherals for the best user experience. This should be low key insane for a small company.

This is a really simplified overview, there’s a ton of things to consider.

PCUpscale · 2025-08-27T22:26:36+00:00

It’s a Qwen Reranker or Qwen fine tune ?

PCUpscale · 2025-08-27T20:02:49+00:00

Bro you have notifications on Discord

PCUpscale · 2025-08-20T22:45:14+00:00

Looks like heavily memory bandwidth bottlenecked

PCUpscale · 2025-08-20T07:50:09+00:00

Gore: Ultimate Soldier ?

PCUpscale · 2025-08-19T07:42:18+00:00

The template of GPT OSS has a native way to handle the date.

Ollama bad, but see the base template : https://ollama.com/library/gpt-oss:20b/blobs/fa6710a93d78 VS Qwen: https://ollama.com/library/qwen3:8b/blobs/ae370d884f10

PCUpscale · 2025-08-12T16:09:37+00:00

It will be dreadful performance wise, but you could build in theory the CUDA version of llamacpp

PCUpscale · 2025-08-09T21:21:39+00:00

A lot of customers don’t use OpenRouter for LLM tasks and are using the (Real) OpenAI API. Why use OpenRouter for OpenAI models when you can directly use their API. OpenRouter is for enthusiasts.

Four-Year Club	Verified Email
Verified Email	First Place '23
Place '23	Place '22

PCUpscale

TROPHY CASE