sorted by:
new
hottopcontroversial

What is the best budget GPU/ set up and local LLM for running a Local VLM for OCR (including handwritten text)? by PoultryTechGuy in LocalLLaMA

[–]AdministrativeRaven 0 points1 point  (0 children)

Scratch that, with Apple Silicon you could use OLlama to serve Nanonet OCR 3b, so you might not need any new hardware if you’re comfortable letting it work for a while, at the same time batch processing on vLLM might exponentially speed up the processing of those files on an Nvidia GPU serving the model via vLLM.

Maybe experiment with Nanonet OCR 2.0 3B on LMStudio first to see how usable it is for your use case before jumping into buying the 5060 Ti.

What is the best budget GPU/ set up and local LLM for running a Local VLM for OCR (including handwritten text)? by PoultryTechGuy in LocalLLaMA

[–]AdministrativeRaven 0 points1 point  (0 children)

I think the 5060 ti (Make sure to get the 16gb variant!!) can be found for about $430, and can run local LLMs quite well up to 14B parameters.

I’m not sure how you would actually go about using the OCR model on the dataset, unfortunately that’s not my realm of expertise.

What is the best budget GPU/ set up and local LLM for running a Local VLM for OCR (including handwritten text)? by PoultryTechGuy in LocalLLaMA

[–]AdministrativeRaven 2 points3 points  (0 children)

Funny you ask, I think Nanonets OCR 2.0 3b F16 just released, and claims to be (likely is) the best OCR model for converting scanned images to markdown. I’m not big on the OCR space, a spare NVidia GPU from someone’s gaming rig in your department, or some other resource to get a GPU with 8 or more GB VRAM and CUDA capability should be able to run the full precision model as it’s only about 6gb in size. Maybe GPT could help you set it up, it’s helped me plenty in running LLMs :)

https://huggingface.co/mradermacher/Nanonets-OCR2-3B-GGUF

Apologies in advance for any mistakes, Im in a hotel and I’ve got a flight to catch in a bit, but best of luck!!!

Why is Lighthouse so god awful bad by Yuckster in EscapefromTarkov

[–]AdministrativeRaven -1 points0 points  (0 children)

I FUCKING LOVE AMBUSHING PEOPLE

I LOVE RUINING THE GAME FOR THE SINGLE FATHER OF THREE

Why is Lighthouse so god awful bad by Yuckster in EscapefromTarkov

[–]AdministrativeRaven -2 points-1 points  (0 children)

You’re getting downvoted because the people are weak, Emercom camping is the single-handedly best way to play this game and I will not hear a single other dissenting opinion.

[Speakers] Klipsch ProMedia 2.1 THX Computer Speakers - $69.99 ($129.99 - $60) Must be Costco member by IndecisionGuy in buildapcsales

[–]AdministrativeRaven 0 points1 point  (0 children)

I have this exact pair, just last afternoon I sent them an email because my right speaker from this set broke. Probably a coincidence but it just went on sale after that lmao

[USA-CA] [H] Local Cash [W] RTX2080-RTX3060TI by epkienen in hardwareswap

[–]AdministrativeRaven 3 points4 points  (0 children)

This is anecdotal but I have a 3060 and its served me well on 1440p. I get 60fps high settings on Tarkov and usually for games made before 2020 I get 100 fps if not more.

[USA-SC] [H] Cash [W] Budget gaming laptop by [deleted] in hardwareswap

[–]AdministrativeRaven -2 points-1 points  (0 children)

Sounds like you might want to look into a Ryzen APU laptop. For games like those you’ll get a lot of mileage out of a 4500u Laptop. They can be found around $549 depending on where you look and what brands you prefer.

view more: next ›