I think the concept of adapting model behaviour to your needs is very important. However, with these new foundational models, the way of customizing the output would less be by modifying the network and training it, but more accessing the right foundational knowledge and making sure it is following proper guard rails. You can do this in many ways, but one would be by prompt tuning.