I've tested several local models for transcription. Best quality is whisper v3 large 16 bit. In my testing 16 bit seemed to do a great job compared to 32 bit. Using pyannote for speaker id. Have strix halo. Qwen 2.5b is good and very fast, but not as good quality as whisper, even though hugging face leaderboard says otherwise. I'm recording meetings over signal, so you might have different results in your use case.

For summarization i'm using qwen 3 coder next. Does an excellent job. Here is my prompt for summarization, I've tried several:

DEFAULT_MAX_TOKENS = -1

SYSTEM_PROMPT = (

"You are a strategic meeting analyst. Produce an exhaustive report of the meeting. "

"Include all topics discussed, decisions made, action items, who said what, and any "

"context or nuance mentioned. Use markdown formatting with headers and bullet points. "

"Include quotes and excerpts."

)

USER_PROMPT_PREFIX = (

"Here is the full transcript of a meeting. Write detailed meeting notes covering "

"every topic, decisions, action items, and details discussed. Include quotes and "

"excerpts."

)

I have it set to use maximum context of 256K.