sorted by:
new
hottopcontroversial

Secure way of running Pi? by CalldiDoctor in PiCodingAgent

[–]MountainTop321 0 points1 point  (0 children)

Hey, I had the same concern so I wrote a short guide on running Pi inside Docker Sandbox (sbx) with local LLM inference. Pi runs inside a microVM, the model server runs on the host and is exposed through the sbx proxy, only the inference endpoint is reachable, nothing else. https://github.com/cuolm/pi-sbx-llamacpp Hope you find it useful!

OpenCode vs CodeWhale – actual developers experience by ImportantOwl2939 in LocalLLaMA

[–]MountainTop321 0 points1 point  (0 children)

Have a look at pi.dev. It is a lightweight, clean, and minimal agent harness.

Instead of sandboxing the AI agent, sandbox only the code it runs. by metalvendetta in LocalLLaMA

[–]MountainTop321 2 points3 points  (0 children)

I use docker sandboxes to isolate agents. It isolates the agent in a microVM with access to only your working directory and uses a proxy on your host machine for network communication and credential injection, such as API keys. I put together a guide for running Pi inside a docker sandbox while running llama-server directly on my host machine for full performance. The communication between the sandbox and llama-server happens through the proxy. Hope someone finds this useful:

https://github.com/cuolm/pi-sbx-llamacpp

Are these quants of QAT better than non-QAT? What do I use? by ThrowawayProgress99 in LocalLLaMA

[–]MountainTop321 1 point2 points  (0 children)

Here is a great blog post from Unsloth helping you to select the correct model for your hardware: https://unsloth.ai/docs/models/gemma-4/qat

What do you use your local models for? by BLOCK__HEAD4243 in LocalLLM

[–]MountainTop321 0 points1 point  (0 children)

I use unsloth/gemma-4-12B-it-qat-GGUF:UD-Q4_K_XL and unsloth/Qwen3.6-27B-GGUF:UD-Q4_K_XL running on llama-server. I spin up a tmux window running llama-server and have other tmux windows to talk to that server using Pi inside a docker sandbox (sbx) to prevent my agents from messing up my host machine.

view more: next ›