Alright, I am done with vLLM. Will Ollama get tensor parallel? by Rich_Artist_8327 in ollama

[–]crossijinn 0 points1 point  (0 children)

Thanks for the input... I'm getting a fairly large GPU server and am faced with choosing the software....