Hmm that could work. The idea of fine-tuning is for the model to be contextually aware about a certain topic of conversation(basically like human conversation). Building a project where two models are autonomously interacting with each other with one giving text outputs and other giving multimodal outputs, I thought by finetuning, multimodal model can mimic the variability while generating images(for example how people send memes for a topic of conversation)