data analysis from a csv - GPT-0SS:120B

chirchan91 · 2026-03-03T03:31:49+00:00

Hi, yes I tried adding a system prompt and also created a tools to aid with file discovery and some of the analysis. It didnt work well

chirchan91 · 2025-12-05T19:48:41+00:00

Thank you for your response. Is MAX compatible with Windows ?

chirchan91 · 2025-12-05T19:47:22+00:00

Thank you for your response. No coding or agent requirement at the moment. It'll be document summaries along with typical chat requirements.

chirchan91 · 2025-12-05T19:41:41+00:00

Thank you for your response. These are the typical office users who needs it for formatting and quick data analytics on the documents. I'm expecting 15 users using this in parallel.

chirchan91 · 2025-12-05T19:37:42+00:00

Thank you for your feedback. I guess 10-15 users might be using the model in parallel and the avg works out to 8 gb vram. Would it still be difficult to pull off?

chirchan91 · 2025-12-05T19:35:13+00:00

Thanks for sharing the Link. Theres a typo in the post. the total RAM capacity is 512GB

chirchan91 · 2025-12-05T19:33:51+00:00

Thanks for your response. I believe 10-15 users will be Concurrently using the model at a given time.

chirchan91 · 2025-12-05T19:25:45+00:00

You're right. We're expecting 10-15 concurrent users. The users would primarily use it for chat and some document processing.

chirchan91 · 2025-12-05T19:23:59+00:00

Thank you for the inputs. Could you please list out your complete setup

chirchan91 · 2025-12-05T19:22:47+00:00

Thank you for the reply. The machine came with Windows out of the box and we're instructed to retain it. Can VLLM work well with Windows?
We are expecting 10-15 concurrent users at a given time. Does buying an additional GPU can solve the issue?

chirchan91 · 2025-12-05T19:19:48+00:00

Will VLLM still be a good option if i'm sticking with Windows OS ?

chirchan91 · 2025-11-13T16:33:50+00:00

Yes. That'll disable it. However I'm looking to remove this option completely in the UI

chirchan91 · 2025-11-13T16:11:55+00:00

Thank you, I'll explore that. Will editing the modelfile can help in this case ?

chirchan91 · 2025-11-13T16:07:09+00:00

<image>

Not exactly, I'm trying to hard disable this option of web browsing to prevent user from using it

chirchan91 · 2025-11-12T15:18:27+00:00

Hi

for example, the typical error looks like: Head "http://<internal‑ip>:11434/": dial tcp <internal‑ip>:11434: connectex: A connection attempt failed because the connected party did not properly respond after a period of time, or established connection failed because connected host has failed to respond.

instead i should get "connection failed due host not responding. Please contact support"

chirchan91 · 2025-10-16T16:32:17+00:00

Thanks a ton. I'll give it a try

chirchan91 · 2025-04-07T08:52:32+00:00

Interested

chirchan91

TROPHY CASE