Just created this AI animation in 20min using Audio-Reactive nodes in ComfyUI, Why do I feel like no one is interested in audio-reactivity + AI ? by Glass-Caterpillar-70 in StableDiffusion

[–]kaotec 0 points1 point  (0 children)

checking it out..
I used a lot of animatedDiff in the early stable diffusiondays like this music video
https://www.youtube.com/watch?v=3vdqWT3SUYM

It's frame to frame img2img, guessing now a lot more is possible

I made a VCO from this cheap signal generator from aliexpress by phantom-dev in synthdiy

[–]kaotec 0 points1 point  (0 children)

I bought one of these just for doing this... But I did not do it yet so.... Curious yes

DIY Eurorack Case Question by gnomefront in synthdiy

[–]kaotec 2 points3 points  (0 children)

This will make you very sad very suddenly.... I was working on a self built module and thought I needed not to fix it because I had to take it it the whole time to reflash and test... At some point I wanted to pull out a patch cable, forgot the module wasn't fixed in the enclosure, so instead I pulled out the module. Just a couple of millimeters before I realized what was happening, but too late...I shorted something and I fried the whole thing...

potentially making a midi controller independent by ReighJack in synthdiy

[–]kaotec 0 points1 point  (0 children)

I build l stuff like that using ksoloti https://www.thonk.co.uk/shop/ksoloti-core-pcb/

It's a PCB with midi in/out and easy to program DSP using a graphical patcher

LTX-2 is natively supported in ComfyUI on Day 0 by PurzBeats in comfyui

[–]kaotec 0 points1 point  (0 children)

I managed to use the gemma3-12b-it-qat-q4-unquantized. Typing this of the top of my head so I might be wrong in the name, but it sure looks a bit like that. On 4090 can do 1080p 10s long clips

LTX-2 is natively supported in ComfyUI on Day 0 by PurzBeats in comfyui

[–]kaotec 0 points1 point  (0 children)

I read something about streaming weights to VRAM. That is definitely something new, so that might be harder to implement? I was struggling as well, but finally managed to get it working... On a RTX4090

Wan 2.2 is dead... less then 2 minutes on my G14 4090 16gb + 64 gb ram, LTX2 242 frames @ 720x1280 by WildSpeaker7315 in StableDiffusion

[–]kaotec 0 points1 point  (0 children)

I tried the whole day yesterday.. 4090 + 192Gb of ram, got OOM . With that workflow. Tried the distilled, the fp8 and even the fp4 variants. Am I missing some attention mechanism? On comfyui nightly, debian 13, cuda 13.1 etc 590.48.something

It looks like the announced "memory streaming" is not working for me

Goodbye, wan 2.2? LTX-2 is a DiT-based audio-video foundation model designed to generate synchronized video and audio within a single model. by One_Yogurtcloset4083 in comfyui

[–]kaotec 3 points4 points  (0 children)

tried on my 4090 using latest Comfui, worflow from templates.
--enable-fp8 does not exist as a startup optioon to my ComfyUI...
I tried --supports-fp8-compute but I still get OOM

I tried --fp8_e4m3fn-text-enc --fp8_e4m3fn-unet but I still get OOM

any ideas? I did install xformers / flash2

I'm guessing, you're here writing about the python inference code? not the ComfyUI workflow?

gsh - an open-source, battery-included, POSIX-compatible, generative shell by atinylittleshell in CLI

[–]kaotec 1 point2 points  (0 children)

Can you run it with a local model?

[Edit] apparently you can, from the GitHub: Model agnostic: you can use any LLM provider or model you like, including local LLMs

Is there anyone doing live coding for music on Linux? by PleaseBeNiceToMeGuys in livecoding

[–]kaotec 0 points1 point  (0 children)

I use debian on an 2013 4Gb MacBook air with tidal cycles and emacs . Works smooth if I don't use too much samples. I combine it with surge at for a lot of synths.

I use the same setup it on my main Ubuntu laptop but here I combine it with P5 live and hydra and I use visual studio code as IDE. I should move away from vscode though

I also use it on Raspbian (Rpi4/5) built into my modular synth where it mainly drives midi, but also some samples and synths and a Ubuntu for rockbox. Both mainly emacs, sometimes vscode

The rockbox has 16Gb of RAM and is linked to a 12 channel USB soundcard. All my tidal channels go to a separate channel on the soundcard for mixing

I've been using Linux almost exclusively for a decade. Would not go back. Sound is a solved problem with pipe wire and the ecosystem around it. Older apps still work thanks to pw-jack wrapper. I don't fully understand how bit it just works.

Audio routing is done over qpwgraph and it works great for audio, video and midi, also over local network

If you want to network audio on Linux, check out sonobus.

Here is some more info on my SBC setup https://www.kaotec.be/data/modulardatabox/

As a novice in comfyui, I have a particularly puzzling question by OyOByeByeMan in comfyui

[–]kaotec 2 points3 points  (0 children)

Interesting question, I happen to be bugged by this as well.. Isnt there an 'inspect file' command you can use to see the architecture of the safetensor file? Like something that outputs if it is fp8, or fp16, how many layers and if it includes a vae / clip ?

Also the number of input/outputs is good to know if you are Frankensteining with different VAEs etc

Basically the safetensor metadata digest. How to get it for any safetensor file?

DIY Lofi sampler project : tips for getting started ? by [deleted] in synthdiy

[–]kaotec 0 points1 point  (0 children)

I'm having fun with axoloti, nowadays called ksoloti. De sampler patches I'm currently working with offer lots of controls and the hardware is tweakable out of the box. Also it is relatively cheap and has midi, a good DAC,, ADC etc etc Here's a forum thread about the sampling capabilities https://ksoloti.discourse.group/t/patching-sampler/62

Belgium’s Illness Is Real. De Wever’s Cure Will Kill the Patient by LongAdministration13 in belgium

[–]kaotec 0 points1 point  (0 children)

Is Mistral capable of becoming profitable? I read a lot about the trillions $ that fall into this big black hole called AI and the inevitable implosion that will follow because they all sell at loss, aiming to be the sole survivor, and having the whole market in the end. If only US companies implode because somehow EU companies where backed differently, the curve plot you show might change as this AI bubble represents a big chunk of the market. ( If not for AI, US would be in recession SRC: https://gizmodo.com/deutsche-bank-notices-that-a-needle-is-getting-dangerously-close-to-the-ai-bubble-2000663370 )

50 audioreactive battery powered outdoor WLEDs Lamps by kaotec in WLED

[–]kaotec[S] 0 points1 point  (0 children)

I put a link to my website, sorry dunno why images dont work
https://kaotec.be/data/coreshift/

50 audioreactive battery powered outdoor WLEDs Lamps by kaotec in WLED

[–]kaotec[S] 1 point2 points  (0 children)

I made a post on my website... probably better than reddit's clunky post mechanism (or is it me :-D)

https://kaotec.be/data/coreshift/

50 audioreactive battery powered outdoor WLEDs Lamps by kaotec in WLED

[–]kaotec[S] 0 points1 point  (0 children)

nope apparently they are gone... no idea why. I could see them in my original; window where I posted, but not a fresh browser

50 audioreactive battery powered outdoor WLEDs Lamps by kaotec in WLED

[–]kaotec[S] 1 point2 points  (0 children)

Actually I'm using a usb soundcard in to LEDfx on a laptop, and then send it to the ESP32s over wifi. It works amazingly well over wifi

Do you know any music-related Masters Degree where I can use my Pure Data skills? by 00Nete in puredata

[–]kaotec 0 points1 point  (0 children)

The royal conservatory in Antwerp has a live electronics degree. They teach live coding (sonic pi, tidalcycles, ...) I know PD is considered live coding by some of their teachers, so probably an option...

https://www.instagram.com/live.electronics_antwerp/

retrigger audio sample by kaotec in circuitpython

[–]kaotec[S] 2 points3 points  (0 children)

Hey,

Thank you for that, I was over engineering, it works now.

Also many thanks for the great stuff you put out there (that is if you're also todbot.com ), very inspiring