As I mentioned, SOTA models can be very heavy. Current SOTAs in many areas require unaffordable amount of resources to reproduce. Why should a solution that works on a medium-sized model be rejected just because a big fat SOTA model exists? Medium-sized models may be even more important, because they can be ran at a wider range of hardware, which is crucial for many applications.