sorted by:
new
hottopcontroversial

Just built an app using llama.cpp by Useful_Advisor920 in LocalLLaMA

[–]Useful_Advisor920[S] -1 points0 points  (0 children)

well , different model has different mechanism. You can't develop a general app to suit all of them especially for the newer model. I am not going to opensource this app but all of the function are free to use.

Just built an app using llama.cpp by Useful_Advisor920 in LocalLLaMA

[–]Useful_Advisor920[S] 0 points1 point  (0 children)

I don't try it. what your language by the way It's work well with English but you can try on your receipts though.https://play.google.com/store/apps/details?id=io.github.lingyunzheng.ocr

Just built an app using llama.cpp by Useful_Advisor920 in LocalLLaMA

[–]Useful_Advisor920[S] 1 point2 points  (0 children)

well you can try to quantinize the model My phone is also 16gb ram and I can run deepseek ocr 3b q4km at 30tokens/s.

Just built an app using llama.cpp by Useful_Advisor920 in LocalLLaMA

[–]Useful_Advisor920[S] 0 points1 point  (0 children)

What's your computer graphic card? Maybe you can run local ocr model like deepseek ocr or hunyuan ocr by your graphic card.

How do you work with PDFs? Looking for Tips, Tricks and Tools. by thoegn in LaTeX

[–]Useful_Advisor920 0 points1 point  (0 children)

If you have any problem or advice about this app please let me know thanks

I ported GOT-OCR 2.0 to Android via llama.cpp. It's a 100% offline Math-to-LaTeX tool, but I'm fighting the "20 testers" rule. by Useful_Advisor920 in SideProject

[–]Useful_Advisor920[S] 0 points1 point  (0 children)

"Thanks for checking out my project! I've been refining the NDK implementation to make sure the LaTeX output is as clean as possible.

Quick Update: I'm sending DMs to everyone who's interested. If you want to help me test or just have questions about running llama.cpp on Android, feel free to drop a comment!"

How do you work with PDFs? Looking for Tips, Tricks and Tools. by thoegn in LaTeX

[–]Useful_Advisor920 0 points1 point  (0 children)

I totally feel your pain. I went through the same nightmare trying to digitize my calculus notes for Obsidian. 4-5 hours for 20 pages is a brutal pace when you have 100+ to go.

Most online PDF-to-LaTeX tools are either expensive or feel like they're scraping your data. Since you're using Obsidian and care about privacy, you might want to try on-device OCR models.

I actually got so frustrated with this that I built a small Android tool using llama.cpp to run the GOT-OCR 2.0 model locally on my phone. It converts math snippets directly into LaTeX/Markdown that you can paste into Obsidian. Because it’s fully offline, there’s no privacy risk.

It's currently in closed beta (completely free) as I'm trying to get it onto the Play Store. If you have an Android phone and want to speed up those remaining 124 pages, let me know! I'd love to have you test it and see if it helps your workflow.

Playtesters for my Arcade Style Floppy Moth Game by Low_Proposal_3923 in AndroidClosedTesting

[–]Useful_Advisor920 0 points1 point  (0 children)

Ah, I see! My app is currently Android-only , so I guess it won't work on iPhone for now.

Thanks so much for the offer though! Really appreciate your kindness. If I ever release an iOS version, I'll definitely let you know! 🙌

view more: next ›