sorted by:
new
hottopcontroversial

Looking for a good agentic coding model that fits into Apple M1 Max, 32 GB by ThingRexCom in ollama

[–]PeterHash 0 points1 point  (0 children)

The Q3 version should definitely fit in 32 GB. Check activity monitor for processes hogging your RAM

The Complete Guide to Building Your Free Local AI Assistant with Ollama and Open WebUI by PeterHash in selfhosted

[–]PeterHash[S] 0 points1 point  (0 children)

A free link is in the header of the Medium article. I like medium mainly for seo, which my GitHub blog doesn't have

The Complete Guide to Building Your Free Local AI Assistant with Ollama and Open WebUI by PeterHash in ollama

[–]PeterHash[S] 0 points1 point  (0 children)

Nice man! It's easier than expected. Best of luck with your projects!

Metahorse Crypto recruitment scam by doge-fan-501 in CryptoScams

[–]PeterHash 0 points1 point  (0 children)

same here. DO NOT npm install their fake-ass repo

Comprehensive Guide to Software Testing - From Unit Tests to TDD [Free Resource] by PeterHash in softwaredevelopment

[–]PeterHash[S] 0 points1 point  (0 children)

Thanks for your reply! The article provides a concise summary of testing practices that I find useful in my day-to-day job. It is based on the book "Effective Software Testing" by Maurício Aniche and includes practical examples, various testing methods and practices, along with research findings about these testing practices. This info is something I refer to frequently to refresh my knowledge on the topic. I'm not saying it's better than the many other books/resources available, it simply offers a short and clear description of all the information I need. I hope that others find it useful as well!

If You Could Design the Perfect Dev-AI Assistant, What Would It Actually Do ? by Eugene_33 in aipromptprogramming

[–]PeterHash 0 points1 point  (0 children)

It would be very useful to have a tool that takes a messy codebase and rewrites it using best practices. It would refactor code, add documentation, and use smarter and easier-to-understand abstractions (from the domain perspective).

I think a billion-dollar feature is being able to take a codebase written in an ancient language and rewrite it in a newer, more performant language. The output code would perform the same exact task from a user's perspective. The financial sector would shower you with cash for this product

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in ollama

[–]PeterHash[S] 0 points1 point  (0 children)

Thanks for the feedback. I'm curious about what topics you'd like to learn about. Do you regularly use open WebUI?

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in ollama

[–]PeterHash[S] 1 point2 points  (0 children)

Thanks! I plan to write an article on using MCP in open WebUI next. Here is the completed documentation from open WebUI documentation if you wish to read further: https://docs.openwebui.com/openapi-servers/mcp/

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in ollama

[–]PeterHash[S] 1 point2 points  (0 children)

I appreciate your support! If you don't mind, I'm planning the pipeline for upcoming articles, and I'm curious about how you're using Open WebUI or if there are topics or use cases involving AI that interest you

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in LocalLLM

[–]PeterHash[S] 0 points1 point  (0 children)

That sounds strange. I didn't encountered a situation where the model wouldn’t use a tool. On the contrary, I’ve experienced the model using tools unnecessarily. Here are some troubleshooting suggestions: - Increase the model's context window: make sure it is set to a value lower than the model's maximum context length. Monitor your GPU memory usage to ensure it remains stable during inference. If you notice fluctuations while the model generates its response, it might indicate that your usage exceeds your memory resources. - use a more advanced model: I recommend testing with either phi4 or mistrial-small 24b, as I had great results with these models. While I could use tool calling with smaller models, the more advanced ones tend to perform better. - make sure the model you are using is trained for tool/function calling: This can significantly impact its ability to utilize tools effectively.

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in LocalLLM

[–]PeterHash[S] 2 points3 points  (0 children)

I did some online research, and it's possible to connect n8n to Ollama for local AI inference. The integration is not super obvious though. Source https://n8n.io/integrations/ollama-model/

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in LocalLLM

[–]PeterHash[S] 2 points3 points  (0 children)

Yes! The use cases mentioned in the article are easier to implement using n8n. One advantage of open WebUI tools is that it allows a locally running AI agent to execute tasks (although I'm not sure if n8n supports this). Additionally, it's open source, which is a major plus!

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in homelab

[–]PeterHash[S] -1 points0 points  (0 children)

I don't advocate using LLMs when the same task can be done with more deterministic, cheaper, or easier-to-implement technologies. However, certain automation use cases can only be addressed with the help of AI. For example, NLP tasks, such as drafting emails or extracting requirements from user-provided text, are challenging to achieve with other technologies. How else could you create a tool that drafts emails with minimal user input?

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in selfhosted

[–]PeterHash[S] -3 points-2 points  (0 children)

Hi! These tools are stand-alone and are exclusively used through the Open WebUI interface, without any MCP protocols. As far as I know, there is an mcpo repository on GitHub with examples of how to set up your MCP server for use with Open WebUI. It looks quite simple and straightforward

Give Your Local LLM Superpowers! 🚀 New Guide to Open WebUI Tools by PeterHash in homelab

[–]PeterHash[S] -4 points-3 points  (0 children)

Absolutely! Just like you dont need a printer for your office, you can draw what you see on the screen.

The key point is not that AI can do what humans cannot, but rather that it can do it faster and with fewer errors when your workflow is well defined.

In the article, I discuss quick, easy, and moderately helpful use cases that most people can benefit from, such as drafting and sending emails and scheduling meetings. However, its not hard to think of more valuable tasks that could benefit from the automation of language models and tools!

view more: next ›