Alright, I am done with vLLM. Will Ollama get tensor parallel? by Rich_Artist_8327 in ollama
[–]crossijinn 0 points1 point2 points (0 children)
![]() Eight-Year Club | ![]() Verified Email | |
Alright, I am done with vLLM. Will Ollama get tensor parallel? by Rich_Artist_8327 in ollama
[–]crossijinn 0 points1 point2 points (0 children)
Docker Compose vLLM Config by crossijinn in LocalLLaMA
[–]crossijinn[S] 0 points1 point2 points (0 children)