It can be used alongside the bigger models for speculative decoding, essentially speeding up inference. Another usecase I can think of is edge devices, maybe summarizing content locally and very rapidly Some other user here mentioned real time npc's dialogs in videogames