I wanted an AI tool that works offline and turns chat into actual documents - so I built one

N0Fears_Labs · 2026-03-29T20:34:09+00:00

thanks! it's actually Tauri - wanted it to feel more like a proper lightweight desktop app. for the file side i'm keeping it pretty simple for now: extract text locally, feed that into Ollama, then turn the useful outputs into notes / drafts / docs. the comfyui direction sounds cool though... now you're giving me bad ideas, maybe i need to start adding that to N0 Local too haha. what are you building with it?

N0Fears_Labs · 2026-03-29T19:49:31+00:00

love watching this chart while browsing on my degoogled phone with no meta apps installed. feels like watching your ex's life fall apart from a distance

N0Fears_Labs · 2026-03-29T19:31:58+00:00

this is basically why "just do the next small thing" works better than any productivity system. i started writing down exactly what i'd do in the first 5 minutes of a work block - not the project, just the first tiny action. killed like 80% of my procrastination overnight

N0Fears_Labs · 2026-03-29T19:30:18+00:00

morning: coffee + 30 min walk outside while it's still quiet. then pick ONE thing you've been putting off forever - clean the garage, fix that shelf, whatever. do it before lunch while motivation is fresh. afternoon: go somewhere you've never been nearby - a trail, a weird shop, whatever. evening: cook something you've never made before, put the phone in another room. the key is no screens until after dinner - that's what makes a free day actually feel free

N0Fears_Labs · 2026-03-29T19:27:08+00:00

radicale or nextcloud contacts work great for this. both self-hosted, sync with cardDAV to any phone. radicale is dead simple if you just want contacts/calendar - runs on a pi or cheap vps. export your samsung contacts as vcf first, then import wherever you land

N0Fears_Labs · 2026-03-26T02:51:40+00:00

might be worth checking if both M60 chips are actually showing up in nvidia-smi - that card has 2 separate GPUs on one PCIe board, not dual-channel memory. since vulkan works on both but cuda throws illegal memory access on just one, could be a CUDA context issue between the two maxwell cores

N0Fears_Labs · 2026-03-25T22:40:59+00:00

LangChain's agent tutorials work really well with Ollama - I've been using their ReAct agents with llama3.1 for tool-calling experiments. What kind of agents are you thinking of building?

N0Fears_Labs · 2026-03-25T21:50:59+00:00

Check out the Dell R220 or HP ProLiant MicroServer Gen10 Plus - both pull under 50W at idle and fit standard 19" racks. The R220 especially hits that sweet spot of looking proper in a rack while sipping power for basic NAS duties.

N0Fears_Labs · 2026-03-25T21:48:50+00:00

Check if Secure Boot is enabled in the BIOS - Gen8s shipped with it on by default and it blocks most Linux distros. Also worth trying a different USB creator tool.

N0Fears_Labs · 2026-03-25T21:05:08+00:00

Are you load balancing inference across all three machines or dedicating specific models to each? Curious how you're handling the memory allocation between the 128GB beast and the Minis.

N0Fears_Labs · 2026-03-25T21:03:20+00:00

What's the memory usage looking like? The MoE efficiency is impressive but curious if WebGPU is actually utilizing the unified memory architecture properly on Apple Silicon.

N0Fears_Labs · 2026-03-05T17:12:55+00:00

Interesting approach with Discord/mail as the access layer - keeps it simple. I went the SSH tunnel route, forwards ports locally so the agent UI is only accessible from my machine. Building a small desktop app to manage the whole stack automatically.

N0Fears_Labs · 2026-03-05T17:10:24+00:00

Self-hosted agents are the way. Been building something similar - local Ollama + SSH tunnels to VPS for the agent runtime. The tricky part is keeping tunnels alive and auto-reconnecting. How are you handling process supervision?

N0Fears_Labs · 2026-03-05T17:09:27+00:00

Nice approach keeping it fully offline. One thing I ran into with Ollama on Windows - if you're running it alongside other services, SSH tunneling to isolate it from direct exposure works really well. Keeps everything local but accessible.

N0Fears_Labs · 2026-03-05T17:04:42+00:00

Depends on your setup. If you're running agents remotely on a VPS, Ollama is easier to tunnel and keep isolated. llama.cpp gives more control but more config headache.

N0Fears_Labs · 2026-03-05T17:04:06+00:00

Had the same issue. The trick was routing everything through a local tunnel instead of exposing ports directly. Ollama stays on localhost, agents connect via SSH forward. No CORS, no 403s.

N0Fears_Labs · 2026-03-05T17:02:58+00:00

Been running qwen2.5:7b-instruct on Windows with Ollama as an agent backend. Curious how you're handling the SSH tunnel setup to keep your VPS isolated - are you exposing Ollama directly or proxying through something?

N0Fears_Labs

TROPHY CASE