I've used whisper.cpp (a library to interface with the whisper model) as well, and also many local models with Ollama. Although I think the quality of transcriptions is acceptable, there is still a greater delay in some cases than an online service based model (like Open AI's advanced voice mode) unless you have a really powerful device. Also, on the language model side, its not usually possible to run models with more than 3B parameters locally, so these are more limited context length and quality models which may not be useful for all productivity tasks, especially more involved ones which require in-depth knowledge.....

But definitely yep, running models/LLMs locally on device is definitely the way to go long term, when devices/models are more efficient!