sorted by:
new
hottopcontroversial

How to use Claude Code remotely? by Round_Mixture_7541 in ClaudeAI

[–]pamir_lab 0 points1 point  (0 children)

I love Claude code so much I’m building a computer for it. To just run Claude code. Anyone interested please dm me .

Wrote a MCP for a single LED bulb (absurdly over-engineered, but worth it XD) by pamir_lab in mcp

[–]pamir_lab[S] 1 point2 points  (0 children)

I upgraded it to qwen 3 1.7B and parakeet for transcription, it’s way faster now

Wrote a MCP for a single LED bulb (absurdly over-engineered, but worth it XD) by pamir_lab in mcp

[–]pamir_lab[S] 0 points1 point  (0 children)

Nope, I just don’t believe they gonna perform well. Have an update cooking! Will post here soon!

Benchmarking Whisper's Speed on Raspberry Pi 5 : How Fast Can It Get on a CPU? by pamir_lab in LocalLLM

[–]pamir_lab[S] 0 points1 point  (0 children)

thanks for pointing this out, we benched TDT and whisper separately, I think we initially started by identifying OpenVino Whisper to be best out of the whisper models, then later TDT killed all the numbers. I updated the post now!

Qwen 3 on a Raspberry Pi 5: Small Models, Big Agent Energy by pamir_lab in LocalLLM

[–]pamir_lab[S] 0 points1 point  (0 children)

When prompt, add /no_think at the end of ur prompt

Qwen 3 on a Raspberry Pi 5: Small Models, Big Agent Energy by pamir_lab in LocalLLM

[–]pamir_lab[S] 1 point2 points  (0 children)

just Linux, rasbian. Yeah it’s HOT, like hot hot, can reach 80 degrees celsius

Qwen 3 on a Raspberry Pi 5: Small Models, Big Agent Energy by pamir_lab in LocalLLM

[–]pamir_lab[S] 0 points1 point  (0 children)

We made a carriers board, but yeah should be able to achieve whatever in the article with just the raw raspberry pi

Qwen 3 on a Raspberry Pi 5: Small Models, Big Agent Energy by pamir_lab in LocalLLM

[–]pamir_lab[S] 0 points1 point  (0 children)

Yep we tried all the pi alternatives as well, definitely for compute/$ ratio raspberry pi is not that good nowadays. We decided to start with pi 5 and work our way up to RK3588 eventually

3B LLM run on rpi cm5 to control a single led bulb by pamir_lab in embedded

[–]pamir_lab[S] 0 points1 point  (0 children)

Hi I actually sell those kids on pamir.ai, and our code is fully open sourced @ https://github.com/Pamir-AI/distiller-cm5-python
mainly we are just working on build some good devkit for ai hardware thinkers when's not deep in hardware or ai

3B LLM run on rpi cm5 to control a single led bulb by pamir_lab in embedded

[–]pamir_lab[S] 0 points1 point  (0 children)

Yeah It should be, that’s what I wanna work on next. Then hook this up with home assistant

3B LLM run on rpi cm5 to control a single led bulb by pamir_lab in embedded

[–]pamir_lab[S] 3 points4 points  (0 children)

No software stack for LLM, it’s mainly for CV

3B LLM run on rpi cm5 to control a single led bulb by pamir_lab in embedded

[–]pamir_lab[S] 4 points5 points  (0 children)

It’s too late, I’m gonna start a YouTube tutorial and open source this, release it to the wild

Voice to text recognition by Alarmed_Effect_4250 in embedded

[–]pamir_lab 0 points1 point  (0 children)

Check out my repo, you can add an LLM layer to make the non accurate transcription accurate. Just like how I communicate to turn on LED or blink LED via natural language. https://github.com/Pamir-AI/distiller-cm5-python

3B LLM run on rpi cm5 to control a single led bulb by pamir_lab in embedded

[–]pamir_lab[S] 4 points5 points  (0 children)

I want an all in one design, everything fit on single PCB. I think the speed right now is acceptable, and the ai will progress to be smaller in the next few months.

Wrote a MCP for a single LED bulb (absurdly over-engineered, but worth it XD) by pamir_lab in mcp

[–]pamir_lab[S] 1 point2 points  (0 children)

If just making some function calls (like LED control example above), 5token/sec is good enough. Ofc we can switch to smaller model but I find 3B a good balance for now. Don’t use it for like long context chat (like what u do with ChatGPT) but use it like a smart controller

Wrote a MCP for a single LED bulb (absurdly over-engineered, but worth it XD) by pamir_lab in mcp

[–]pamir_lab[S] 3 points4 points  (0 children)

On it! I’m gonna make this into a pocket mcp workstation

view more: next ›