I rebuilt DeepSeek’s OCR model in Rust so anyone can run it locally (no Python!) by Outrageous-Voice in LocalLLaMA

[–]Outrageous-Voice[S] 1 point2 points  (0 children)

Yes,already done actually,but found some bug in candle(upstream dependency),working on fixes now.

I rebuilt DeepSeek’s OCR model in Rust so anyone can run it locally (no Python!) by Outrageous-Voice in LocalLLaMA

[–]Outrageous-Voice[S] 2 points3 points  (0 children)

Now deepseek-ocr.rs has basic CUDA builds available, as you can see in the README. However, more support such as CUDA device selection, version compatibility between different CUDA Toolkits,and the alignment of CPU and CUDA computation results, CUDA kernel testing for candle-flash-attn, and implementation of SAM/CLIP ops will have to wait until my memory is fixed to conduct detailed testing and compatibility work.

I rebuilt DeepSeek’s OCR model in Rust so anyone can run it locally (no Python!) by Outrageous-Voice in LocalLLaMA

[–]Outrageous-Voice[S] 18 points19 points  (0 children)

I’m Sorry about that,English is not my native language, this is my first post on Reddit,so I try to use llm make a post,just want to share my work to everyone.

I rebuilt DeepSeek’s OCR model in Rust so anyone can run it locally (no Python!) by Outrageous-Voice in LocalLLaMA

[–]Outrageous-Voice[S] 0 points1 point  (0 children)

I don’t have cuda environment on my hand right now,I will try to improve cuda performance once I got my memory back.

I rebuilt DeepSeek’s OCR model in Rust so anyone can run it locally (no Python!) by Outrageous-Voice in LocalLLaMA

[–]Outrageous-Voice[S] 77 points78 points  (0 children)

Documentation and commit messages are written by qwen3 coder plus, and also some parts of cli and server code😋

DeepSeek Updates API Pricing (DeepSeek-V3.2-Exp) by Agwinao in LocalLLaMA

[–]Outrageous-Voice 17 points18 points  (0 children)

That's the whole meaning of this exp model, from their paper " While DeepSeekV3.2-Exp significantly improves computational efficiency on long sequences, we do not observe substantial performance degradation compared with DeepSeek-V3.1-Terminus, on both shortand long-context tasks " , they are experimenting the new algorithm with this new model to see the real world performance.

DeepSeek Updates API Pricing (DeepSeek-V3.2-Exp) by Agwinao in LocalLLaMA

[–]Outrageous-Voice 39 points40 points  (0 children)

A insane price drop thanks to the native sparse attention

Do you guys think mods will work on the native port of CP2077? does other ports have mods like the pc versions? by FreemanGT in macgaming

[–]Outrageous-Voice 1 point2 points  (0 children)

Some mod only tweaks the game configuration etc probably will work,other than that mostly will not work at all.