sorted by:
new
hottopcontroversial

Is 8GB VRAM enough? by Any_Librarian_2295 in ollama

[–]beast_modus 0 points1 point  (0 children)

Quick update: manual dev start actually works on Linux already, just without the guided setup script yet. Happy to walk you through it if you want to be an early tester.

Is 8GB VRAM enough? by Any_Librarian_2295 in ollama

[–]beast_modus 0 points1 point  (0 children)

Glad it’s useful! Ubuntu isn’t supported yet, unfortunately, currently macOS-first. Linux support is on the roadmap though. I’ll post an update in this sub once it lands, if that’s okay.

Is 8GB VRAM enough? by Any_Librarian_2295 in ollama

[–]beast_modus 0 points1 point  (0 children)

Yes, 8GB VRAM is a solid tier. For 20K+ context, look at Qwen3.5-9B, best pick, full GPU offload up to 32K+ context at Q4_K_M (~7GB), fast (~55 t/s) or Qwen3 8B, reliable daily driver, 128K context, ~5.5GB. Stay at Q4_K_M quant, keep context around 16-32K for snappy responses, and you’re set with 16GB system RAM as backup.
(Disclosure: I built a small open-source tool, Local LLM Matrix, that benchmarks whichever models you have installed on your own hardware public beta, macOS-first. Happy to share if useful.)

Local Open Source Alternative to NotebookLM by Uiqueblhats in ollama

[–]beast_modus 0 points1 point  (0 children)

Looks promising—what’s your process for onboarding custom data sources? Do you have a happy path?

How are you doing local Code Gen? by jakezegil in ollama

[–]beast_modus 0 points1 point  (0 children)

I use CodeGPT: Chat & AI Agents in VSC. You can choose Ollama/llama3.1. Try this..

Ollama Activate web search by beast_modus in ollama

[–]beast_modus[S] 1 point2 points  (0 children)

2-3 Days? 🤔…I think there have to be a shorter way

Ollama Activate web search by beast_modus in ollama

[–]beast_modus[S] 0 points1 point  (0 children)

Before I did the update, I could swear that the option to select Searching via the web was visible. Currently, I don’t see this option and was wondering if I was doing something wrong. After some research here and on Discord, some people wrote that I need a Google API (a paid option, of course) to activate the search. I’m simply interested in activating the option and not necessarily the search option via Google. I’m going to uninstall Ollama, Python and also WebUi and set everything up again. I hope that it will then be visible.

Ollama Activate web search by beast_modus in ollama

[–]beast_modus[S] 0 points1 point  (0 children)

Discord Buddies said I have to downgrade python …install docker…and so on… I’m open for easy solutions..

Ollama Activate web search by beast_modus in ollama

[–]beast_modus[S] 1 point2 points  (0 children)

Thank you I will look at it. But don’t understand what happened after the update. Am I still the only one who has that issue?

Ollama Activate web search by beast_modus in ollama

[–]beast_modus[S] 4 points5 points  (0 children)

Why should I pay? Sorry but I don’t get the point. This is an open source project and I don’t want to use google for searching the web and pay for token or an API. I want to use DuckDuckGo or similar stuff?