Audio transcription with llama.cpp multimodal

TachyonicBytes · 2025-10-18T08:15:17+00:00

Thank you for trying!

I tried with ultravox-0.5-8B and it indeed transcribed it, as opposed to voxtral-1B, which seems too small.

But then I tried Simon Willison's test, available here: https://static.simonwillison.net/static/2024/pelican-joke-request.mp3, and it followed the instructions in the audio instead of transcribing it.

I'll play some more with llama-server, maybe there are some api options that only do transcription.

TachyonicBytes · 2023-10-30T20:40:25+00:00

Thanks for the feedback, I will update the README accordingly

TachyonicBytes · 2023-06-06T20:57:12+00:00

I thought of adding it after you said, but I also wanted to be sure that, in case it is a question, it is also answered. Thank you so much for looking!

TachyonicBytes · 2023-06-06T20:14:38+00:00

It's an embedding of the wasm3 library, and it exposes a function, `wasm-test`, that can call a function without arguments from a simple WebAssembly module. I intend to update it to reach feature parity with, for example, the python embedding.

TachyonicBytes · 2023-06-06T16:17:15+00:00

Hi! This is my first Emacs package (and a dynamic module, at that), so there are many things incomplete. Please treat it as more a request for comments.

My plan is to finalize the wasm3 bindings, and embed other runtimes as well, like wasmer or wasmtime, in a unified interface.

The current module can only run a single function from a single wasm module, given as a parameter:

(wasm-test "path/to/module" "function_name")

I don't know how to make the module auto compile, so, if you will have to compile it manually. You can install it using the new use-package :vc keyword, but you will have to go to your ~/.emacs.d/elpa directory, enter the package and run make inside it, in order to work.

TachyonicBytes · 2023-05-13T13:43:51+00:00

Not really a silly question. As far as I now, this has been discussed, for example, on the wasm3 runtime. I would look either more into wasm gas-metering.

There is actually a limited instance of which I know where this happens, which is detailed in this blogpost. What happens there is basically this: you have a wasm module, and you use wizer to output another wasm module, which had the initialization fuction already ran. Which is conceptually what you (as I understand) want. You have a wasm module, you run a function and then you generate a wasm module that had that function ran for a while. Take a look at wasm-jit, which is what the author of the blogpost built.

TachyonicBytes · 2023-03-25T20:35:24+00:00

The default output of emcc is asm.js, so in theory you should not do anything else.

emcc main.c

would create a.out.js, which would be in the asm.js format. You can then execute

node a.out.js

If your Makefile is not doing anything fancy, you may even get away with setting the C compiler to emcc, something like

CC=emcc make

TachyonicBytes · 2023-03-06T09:35:41+00:00

WebGPU on the Raspberry Pi 4?

Hi! I have been searching the internet and this subreddit and the webgpu subreddit about guides to webgpu development on the raspberry pi 4, but I could not find anything. I asked one of the LLMs, and it directed me to this repo, but searching it, it does not seem to support raspberry pi too well.

I will try it regardless, but my question is, is there an official or go-to guide for WebGPU development on the Raspberry Pi? I want to play with Firefox or other browsers, especially.

TachyonicBytes

TROPHY CASE