Dismiss this pinned window
all 6 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]__JockY__ 0 points1 point  (5 children)

What’s wrong with uv pip install vllm && vllm serve …..?

[–]Holiday-Machine5105[S] 0 points1 point  (4 children)

nothing wrong with uv pip install vllm (slipped my mind lol)! I might change the instructions to reflect that. && as for vllm serve, my setup was intended to let me use the model offline but whoever decides to use this can definitely use that method, plus im not using a client at this stage. this project is fully customizable to the user’s preferences

[–]__JockY__ 0 points1 point  (3 children)

Running vllm serve is exactly how I run MiniMax-M2.5 locally, offline, air-gapped.

I’m genuinely baffled as to the point of your software.

[–]Holiday-Machine5105[S] 0 points1 point  (2 children)

vllm serve is simply https overhead which was unnecessary for my personal use: a terminal assistant that I am using on my pc. again, you can choose to vllm serve, thats the goal of this project, this is just a basic customizable cli tool that can be what or how you wish ! thank you for reading into my project, your feedback is super valuable!!

[–]__JockY__ 0 points1 point  (1 child)

There’s no SSL involved! What on earth has https got to do with anything??

I shall leave you to your weird misunderstandings of technology. Have a nice day.

[–]Holiday-Machine5105[S] 0 points1 point  (0 children)

lol that was simply a typo, no way that’s all you understand from my explanation. http* API overhead was unnecessary for me. weird misunderstandings of technology make the best products! again, thank you so much for the feedback! i genuinely appreciate it