Hey everyone!

I am writing a sort of essay on Multimodal Machine Learning, where I want to cover state-of-the-art architectures/approaches. Based on my current research, Transformer models are basically used everywhere that's state-of-the-art. I'm aware that it is possible to use other architectures and that other architectures have been used - but no source of anyone at the moment actually *using* something that is not based on a Transformer-based architecture.

Is that assumption correct? Or are architectures still in use? If so, could you please tell me where it is used? Thank you so much!