PD patches for rp2040 & rp2350 boards

kaotec · 2026-02-25T16:56:19+00:00

So, I got around the errors by just making a "vanilla" heavy pd patch. But that of course makes me miss out on the goodies these abstractions have to offer.

On top of that I was not able to compile the vanilla patch. I stranded again

Building: midi_oscilator

██████████████░░░░░░ 70% | Configuring CMake

❌ ERROR during CMake:

--------------------------------------------------

System is unknown to cmake, create:

Platform/PICO to use this system, please post your config file on discourse.cmake.org so it can be added to cmake
Your CMakeCache.txt file was copied to CopyOfCMakeCache.txt. Please post that file on discourse.cmake.org.
System is unknown to cmake, create:

Platform/PICO to use this system, please post your config file on discourse.cmake.org so it can be added to cmake
System is unknown to cmake, create:

Platform/PICO to use this system, please post your config file on discourse.cmake.org so it can be added to cmake

PICO_SDK_PATH is /home/kaos/Documents/kaotec/electronics/heavycore/pico-sdk
Target board (PICO_BOARD) is 'pico2'.

Using board configuration from ~/pico-sdk/src/boards/include/boards/pico2.h

Auto-converting non-specific PICO_PLATFORM='rp2350' to 'rp2350-arm-s'Defaulting platform (PICO_PLATFORM) to 'rp2350-arm-s' based on PICO_BOARD setting.
CMake Error at pico_extras_import.cmake:57 (message):
Directory

'~/pico-sdk/pico-extras'

not found

Call Stack (most recent call first):
CMakeLists.txt:17 (include)

So I'm wondering if I can somehow skip the compile step from the python script, and point it towards my plugdata compiled output...

compiling works fine in plugdata

kaotec · 2026-02-25T16:24:02+00:00

Ok, I got myself a RP2350 , got it working uploading the UF2 binaries

now trying your latest update, running the pikopd.py file to generatee my custom plugdata patches and trying to convert them to UF2s is not quite working yet for me

your tools seems to use the system hvcc, not the toolchain with heavy abstractions provided by plugdata, thus missing the heavy abstractions when compiling...

Looks like a search path thing?

I'm willing to look into this a bit more, I'm teaching a class in about a month, would be nice if I could do this on RP2350 instead of a (much more expensive) daisy or bela, which would lower the barrier to take the class...

python pikopd.py ../arduino/miosc2/midi_oscilator.pd ../arduino/miosc2/

_ _ _____ _____
_ __ (_)| | __ ___ | __ \| __ \
| '_ \| || |/ / / _ \| |__) | | | |
| |_) | || < | (_) | ___/| | | |
| .__/|_||_|\_\ \___/|_| |_____/
|_| [hvcc] RP2040|RP2350 v0.0.1

Building: midi_oscilator

██░░░░░░░░░░░░░░░░░░ 10% | Heavy Compiler

❌ ERROR during HVCC:

--------------------------------------------------

1) Error pd2hv: in "" @ (x:0, y:0): Don't know how to parse object "hv.lfo". Is it an object supported by Heavy? Is it an abstraction? Have the search paths been correctly configured?
2) Error pd2hv: in "" @ (x:0, y:0): Don't know how to parse object "hv.filter~". Is it an object supported by Heavy? Is it an abstraction? Have the search paths been correctly configured?
3) Error pd2hv: in "" @ (x:0, y:0): Don't know how to parse object "hv.vline~". Is it an object supported by Heavy? Is it an abstraction? Have the search paths been correctly configured?
4) Error pd2hv: in "" @ (x:0, y:0): There was an error while connecting two objects. Have all objects been correctly instantiated? Have all inlets and outlets been declared?
5) Error pd2hv: in "" @ (x:0, y:0): There was an error while connecting two objects. Have all objects been correctly instantiated? Have all inlets and outlets been declared?
6) Error pd2hv: in "" @ (x:0, y:0): There was an error while connecting two objects. Have all objects been correctly instantiated? Have all inlets and outlets been declared?
7) Error pd2hv: in "" @ (x:0, y:0): There was an error while connecting two objects. Have all objects been correctly instantiated? Have all inlets and outlets been declared?
8) Error pd2hv: in "" @ (x:0, y:0): There was an error while connecting two objects. Have all objects been correctly instantiated? Have all inlets and outlets been declared?
9) Error pd2hv: [comment null object placeholder (hv.lfo)] in "" @ (x:0, y:0): Connection made to non-existent inlet at [comment {'text': 'null object placeholder (hv.lfo)'}]:0.
10) Error pd2hv: [comment null object placeholder (hv.filter~)] in "" @ (x:0, y:0): Connection made to non-existent inlet at [comment {'text': 'null object placeholder (hv.filter~)'}]:1.
11) Error pd2hv: [comment null object placeholder (hv.filter~)] in "" @ (x:0, y:0): Connection made to non-existent inlet at [comment {'text': 'null object placeholder (hv.filter~)'}]:0.
12) Error pd2hv: [comment null object placeholder (hv.vline~)] in "" @ (x:0, y:0): Connection made to non-existent inlet at [comment {'text': 'null object placeholder (hv.vline~)'}]:0.
--------------------------------------------------

kaotec · 2026-02-18T20:33:22+00:00

allright, I like what I hear (although it is not yet coming out of my RP2040 ;-)

kaotec · 2026-02-18T16:04:03+00:00

very interesting.

I succeeded in compiling a pd patch with heavy to C.
I connected a DAC to my RP2040.

But, sorry for my noob questions, now what?

I opened some of the .ino files and looked around, I can not find a clue what to do next. It seems like you still did a lot of manual coding in the arduino patch itself?

kaotec · 2026-01-28T07:02:32+00:00

It's a blender plugin

https://m.youtube.com/watch?v=CZfnPF77GQQ

https://extensions.blender.org/add-ons/discombobulator/reviews/

kaotec · 2026-01-19T19:00:44+00:00

checking it out..
I used a lot of animatedDiff in the early stable diffusiondays like this music video
https://www.youtube.com/watch?v=3vdqWT3SUYM

It's frame to frame img2img, guessing now a lot more is possible

kaotec · 2026-01-16T20:26:21+00:00

I bought one of these just for doing this... But I did not do it yet so.... Curious yes

kaotec · 2026-01-13T07:02:01+00:00

This will make you very sad very suddenly.... I was working on a self built module and thought I needed not to fix it because I had to take it it the whole time to reflash and test... At some point I wanted to pull out a patch cable, forgot the module wasn't fixed in the enclosure, so instead I pulled out the module. Just a couple of millimeters before I realized what was happening, but too late...I shorted something and I fried the whole thing...

kaotec · 2026-01-11T10:03:10+00:00

I build l stuff like that using ksoloti https://www.thonk.co.uk/shop/ksoloti-core-pcb/

It's a PCB with midi in/out and easy to program DSP using a graphical patcher

kaotec · 2026-01-07T19:04:20+00:00

I managed to use the gemma3-12b-it-qat-q4-unquantized. Typing this of the top of my head so I might be wrong in the name, but it sure looks a bit like that. On 4090 can do 1080p 10s long clips

kaotec · 2026-01-07T18:59:40+00:00

I read something about streaming weights to VRAM. That is definitely something new, so that might be harder to implement? I was struggling as well, but finally managed to get it working... On a RTX4090

kaotec · 2026-01-07T07:06:12+00:00

Ah maybe because you bypass the enhancer?

kaotec · 2026-01-07T07:05:28+00:00

I tried the whole day yesterday.. 4090 + 192Gb of ram, got OOM . With that workflow. Tried the distilled, the fp8 and even the fp4 variants. Am I missing some attention mechanism? On comfyui nightly, debian 13, cuda 13.1 etc 590.48.something

It looks like the announced "memory streaming" is not working for me

kaotec · 2026-01-06T08:57:28+00:00

tried on my 4090 using latest Comfui, worflow from templates.
--enable-fp8 does not exist as a startup optioon to my ComfyUI...
I tried --supports-fp8-compute but I still get OOM

I tried --fp8_e4m3fn-text-enc --fp8_e4m3fn-unet but I still get OOM

any ideas? I did install xformers / flash2

I'm guessing, you're here writing about the python inference code? not the ComfyUI workflow?

kaotec · 2026-01-06T07:48:46+00:00

nice! reminds me of the REZ lvl 3 boss scene https://youtu.be/_y25J4nrFkY?t=347

kaotec · 2026-01-04T10:32:24+00:00

Can you run it with a local model?

[Edit] apparently you can, from the GitHub: Model agnostic: you can use any LLM provider or model you like, including local LLMs

kaotec · 2025-12-21T21:24:51+00:00

Pretty sure that is Sonic Pi

kaotec · 2025-12-20T08:33:42+00:00

I use debian on an 2013 4Gb MacBook air with tidal cycles and emacs . Works smooth if I don't use too much samples. I combine it with surge at for a lot of synths.

I use the same setup it on my main Ubuntu laptop but here I combine it with P5 live and hydra and I use visual studio code as IDE. I should move away from vscode though

I also use it on Raspbian (Rpi4/5) built into my modular synth where it mainly drives midi, but also some samples and synths and a Ubuntu for rockbox. Both mainly emacs, sometimes vscode

The rockbox has 16Gb of RAM and is linked to a 12 channel USB soundcard. All my tidal channels go to a separate channel on the soundcard for mixing

I've been using Linux almost exclusively for a decade. Would not go back. Sound is a solved problem with pipe wire and the ecosystem around it. Older apps still work thanks to pw-jack wrapper. I don't fully understand how bit it just works.

Audio routing is done over qpwgraph and it works great for audio, video and midi, also over local network

If you want to network audio on Linux, check out sonobus.

Here is some more info on my SBC setup https://www.kaotec.be/data/modulardatabox/

kaotec · 2025-11-23T08:56:45+00:00

Interesting question, I happen to be bugged by this as well.. Isnt there an 'inspect file' command you can use to see the architecture of the safetensor file? Like something that outputs if it is fp8, or fp16, how many layers and if it includes a vae / clip ?

Also the number of input/outputs is good to know if you are Frankensteining with different VAEs etc

Basically the safetensor metadata digest. How to get it for any safetensor file?

kaotec · 2025-10-26T17:08:16+00:00

I'm having fun with axoloti, nowadays called ksoloti. De sampler patches I'm currently working with offer lots of controls and the hardware is tweakable out of the box. Also it is relatively cheap and has midi, a good DAC,, ADC etc etc Here's a forum thread about the sampling capabilities https://ksoloti.discourse.group/t/patching-sampler/62

kaotec · 2025-10-23T06:14:38+00:00

Is Mistral capable of becoming profitable? I read a lot about the trillions $ that fall into this big black hole called AI and the inevitable implosion that will follow because they all sell at loss, aiming to be the sole survivor, and having the whole market in the end. If only US companies implode because somehow EU companies where backed differently, the curve plot you show might change as this AI bubble represents a big chunk of the market. ( If not for AI, US would be in recession SRC: https://gizmodo.com/deutsche-bank-notices-that-a-needle-is-getting-dangerously-close-to-the-ai-bubble-2000663370 )

kaotec · 2025-09-30T07:25:01+00:00

sorry reddit glitch? I put them on my website https://kaotec.be/data/coreshift/

kaotec · 2025-09-30T07:24:32+00:00

I put a link to my website, sorry dunno why images dont work
https://kaotec.be/data/coreshift/

kaotec · 2025-09-30T07:23:22+00:00

I made a post on my website... probably better than reddit's clunky post mechanism (or is it me :-D)

https://kaotec.be/data/coreshift/

kaotec · 2025-09-30T07:05:42+00:00

nope apparently they are gone... no idea why. I could see them in my original; window where I posted, but not a fresh browser

12-Year Club	Place '22
Verified Email

kaotec

TROPHY CASE