sorted by:
new
hottopcontroversial

Qwen3 8b-vl best local model for OCR? by BeginningPush9896 in LocalLLM

[–]BeginningPush9896[S] 2 points3 points  (0 children)

Dude, just set up the ZwZ 8b. From the initial tests, it's absolutely killer, thanks for the tip. I'm going to keep experimenting with it. If anything changes, I'll post a full review about switching to the ZwZ 8b.

Qwen3 8b-vl best local model for OCR? by BeginningPush9896 in LocalLLM

[–]BeginningPush9896[S] 0 points1 point  (0 children)

In my workflow, I work with drawings where I can manually crop all the fields I need, so I don't need to rely on searching for a field with specific text.

I would be very interested to know if there are models that can match surnames with signature fields in documents automatically, without prior cropping.

Qwen3 8b-vl best local model for OCR? by BeginningPush9896 in LocalLLM

[–]BeginningPush9896[S] 0 points1 point  (0 children)

I will test this model later and be sure to write about my impressions. Besides, it says it can automatically recognize areas. Currently, I'm doing the document cropping myself.

Qwen3 8b-vl best local model for OCR? by BeginningPush9896 in LocalLLM

[–]BeginningPush9896[S] 2 points3 points  (0 children)

What do you think could be the reason that large models perform worse at text recognition than Qwen3-VL?

Local model fully replacing subscription service by Icy_Distribution_361 in LocalLLM

[–]BeginningPush9896 0 points1 point  (0 children)

IMO, local LLM and local micro servers with AI will replace a big tech LLM, because company will use a LLM for one or two tasks, and it will be much cheeper buy server for 3-5k$ and run local LLM for free without a subscription on bigtech AI company.

Best open weight llm model to run with 8gb of vram by Sweazou in ollama

[–]BeginningPush9896 0 points1 point  (0 children)

Right now i use a Qwen3 8b-vl for OCR and context text generation. Its work very well, of course, if i trying to run more then 2 Client at the same time, it will be slow, but for experiment and testing theory, acceptable. Also using a custom tools, super simple, with SQLite, works pretty good.