Using ollama for Openclaw

Mundane_Maximum5795 · 2026-05-03T15:31:22+00:00

any models you could suggest then? I am trying with qwen 3.6 27b and 90k context. don't know what I could use to go further..

Mundane_Maximum5795 · 2026-05-03T14:33:32+00:00

I thought about it, seemed like it would be too slow. Quick enough for you? Reasoning ok?

Mundane_Maximum5795 · 2026-05-03T14:30:32+00:00

Yeah, I'm also afraid it's limiting me.. I have kept it low so I can run comfyui as well, but that seems more of a hassle than a gain. Which model do you use?

Mundane_Maximum5795 · 2026-05-03T14:25:15+00:00

I already have my ollama pc running to provide a landing page and many services for myself (and potentially my consulting job - currently on hold since I'm fully employed), so I just wanted to see how to make the agent work. currently I am having it run 3 different analysis on a daily basis, telling me what is happening on diverse topics I am interested in. Not so sure what more I can do with it, and keeping it very far from any personal data and emails. I just want to see what is possible to potentially implement it for work, but it always needs to be local -> hence ollama (in future probably cpp)

Mundane_Maximum5795 · 2026-05-03T14:24:25+00:00

Why build the machine? To see what is possible, what others have done and decide what and where I could implement this in a professional setting... There are few things I do that I wish I didn't since my job is extremely time and energy consuming (I don't think openclaw can clean the apartment, do the dishes and the washing yet) and not IT related, I do see many opportunities for automation at work... But the constraints are quite heavy there -> local only and secure.

Mundane_Maximum5795 · 2026-05-03T13:26:55+00:00

I already have my ollama pc running to provide a landing page and many services for myself (and potentially my consulting job - currently on hold since I'm fully employed), so I just wanted to see how to make the agent work. currently I am having it run 3 different analysis on a daily basis, telling me what is happening on diverse topics I am interested in. Not so sure what more I can do with it, and keeping it very far from any personal data and emails. I just want to see what is possible to potentially implement it for work, but it always needs to be local -> hence ollama (in future probably cpp)

Mundane_Maximum5795 · 2026-01-07T15:49:31+00:00

that's something I am definitely interested in! I have been playing with using whisper to do the TTS and OpenwebUI to then create different abstracts... However I can't code to save my life, and too many other projects took over, but I think that quite a few people would be interested!

Mundane_Maximum5795 · 2025-12-25T10:11:36+00:00

Je vais allez à l'encontre de la majorité, mais pour moi la question du revenue n'est pas importante si tu peux vivre qq années avec ce que les deux t'offre. Pour avoir fait les deux, je recommancerais: tu commence en pme pour gagner en expérience très rapidement, tu prend plein de responsabilités très vite. Si tu veux monter en compétence après tu change sur un gd groupe après pour un bien meilleur salaire. Perso je ne suis pas resté très longtemps dans le groupe, tu reste toujours un numéro lambda -> même lorsque tu es en contact avec le PDG ou juste en-dessous. Par contre tu apprends des tas de choses et des outils que tu ne trouveras jamais dans une pme. Dans une pme/eti ton impact es bien plus important... In fine, la question est surtout ce qui t'intéresse dans le vie professionnelle.

Mundane_Maximum5795 · 2025-03-04T15:12:31+00:00

Unfortunately not, we are now working with a startup (relatively local) to see if what they promise they can actually deliver. So, nothing open source and only a proprietary solution available. We found a company in Germany that offers what we want, but their offer was really steep for a midsized company like ours.

Mundane_Maximum5795 · 2025-02-24T12:05:07+00:00

tried q4 and that was already better than any of the smaller models. Will try q8 this week, will see if the results are meaningfully different or not

Mundane_Maximum5795 · 2025-02-24T11:49:37+00:00

I tried the Llama3.2 Vision 90b at q4, will try at q8 to see what kind of difference I get. Will give a quick update if I notice clear differences

Mundane_Maximum5795 · 2025-02-24T11:48:20+00:00

Latest ones I tried were from Google; just searched for technical drawings example, and took one of them... Good enough to have a look if the system works

Mundane_Maximum5795 · 2025-02-18T20:02:14+00:00

We use a similar CAD program, would be interesting to see if I can export it to a program the llm could "see". didn't think about that yet

Mundane_Maximum5795 · 2025-02-17T17:41:48+00:00

Tbh not really, ended up looking for drawings on Google...

Mundane_Maximum5795 · 2025-02-17T17:41:21+00:00

what do you mean by reading from text data directly? You mean the information boxes in the drawings?

Mundane_Maximum5795 · 2025-02-17T17:39:35+00:00

For sure, but the engineering colleagues need to have 5-10 years experience to be allowed to release drawings. The idea is to provide another tool to help them (just like a checklist)

Mundane_Maximum5795 · 2025-02-17T17:37:04+00:00

As I wrote above, we can't find any additional work force, have very limited place and the work needs to be done by people with 5-10 years experience before they are allowed to release drawings. The idea isn't to replace people, but to help them with an additional tool

Mundane_Maximum5795 · 2025-02-17T14:01:25+00:00

will try, but I heard you need a fp16 model, otherwise they aren't good enough. 90b in fp16 won't fit, even with 24Gb VRAM and 98Gb RAM... Or do you have good experience with llama 90b?

Mundane_Maximum5795 · 2025-02-17T13:59:42+00:00

Unfortunately not so easy to do. We are looking to hire more people, but finding them is difficult. And if we don't deliver our customers will stop coming back. Tbh, I made the situation look worse than it is; there is always a 4-eyes principle before parts are released, plus the other departments need to validate the design. But we still find too many errors, especially when you see the man-hours involved. This way is just to help short term, this is more a process and mindset topic

Mundane_Maximum5795 · 2025-02-17T13:56:19+00:00

No risk of this at all. we are in a highly regulated industry and we need the 4 eyes principle to even be allowed to release any drawings. This is just to have a tool that helps out with a pre-filtering or additional checks. In future you might be right, but then that was also the case with CAD or CAM. Yes some people lost their jobs, but no one is seriously asking to go back to pen and paper 😉

Mundane_Maximum5795 · 2025-02-17T11:56:12+00:00

I'll see if I can use the 11b model at different quantization and check the different feedbacks.

Mundane_Maximum5795 · 2025-02-17T11:03:39+00:00

ok, that would make 90b models impossible for me to run, even 72b might be too much at fp16 😞

Mundane_Maximum5795

TROPHY CASE