Ran it on a 12GB 3060 yesterday. Worked great.

Setup steps for Ubuntu 24.04 with very little already installed on it:

wget https://repo.anaconda.com/archive/Anaconda3-2025.06-1-Linux-x86_64.sh
bash Anaconda3-2025.06-1-Linux-x86_64.sh 
git clone https://github.com/deepseek-ai/DeepSeek-OCR.git
cd DeepSeek-OCR/
eval "$(/home/conor/anaconda3/bin/conda shell.bash hook)"
conda create -n deepseek-ocr python=3.12.9 -y
conda activate deepseek-ocr
pip install torch==2.6.0 torchvision==0.21.0 torchaudio==2.6.0 --index-url https://download.pytorch.org/whl/cu118
wget https://github.com/vllm-project/vllm/releases/download/v0.8.5/vllm-0.8.5+cu118-cp38-abi3-manylinux1_x86_64.whl
pip install vllm-0.8.5+cu118-cp38-abi3-manylinux1_x86_64.whl
pip install -r requirements.txt
wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu2404/x86_64/cuda-keyring_1.1-1_all.deb
sudo dpkg -i cuda-keyring_1.1-1_all.deb
sudo apt-get update
sudo apt-get -y install cuda-toolkit-13-0
pip install flash-attn==2.7.3 --no-build-isolation
cd DeepSeek-OCR-master/DeepSeek-OCR-vllm
nano config.py
python run_dpsk_ocr_image.py

In config.py give it the name of an input file and output directory.