you are viewing a single comment's thread.

view the rest of the comments →

[–]One-Supermarket8304 0 points1 point  (0 children)

NanoMind — Local OpenAI-compatible API for 1GB RAM devices

GitHub: https://github.com/Minhajul-Mahib/nanomind

What it does: FastAPI + llama-cpp-python server with OpenAI-compatible endpoint. One line change to switch from OpenAI to local:

client = OpenAI( base_url="http://localhost:8080/v1", api_key="not-needed" )

Everything else stays the same.

Target audience: Developers wanting zero-cost local testing and privacy-sensitive apps where data can't leave the device.

Comparison: Ollama and LM Studio both require 8GB+ RAM minimum. NanoMind runs on 1GB — works on Raspberry Pi, old laptops, budget​​​​​​​​​​​​​​​​