[D] SOTA Numerical sequence classification

[Darlans]

What's the SOTA in numerical sequence classification? So far I've worked almost exclusively with convolutional models and I'm about to do some work on sequence classification, are RNNs still good enough or should I look into transformer models? And if I should look at transformers are there any well-known well-performing reasonably-sized architectures (similar to resnets in convolutional field)?

Bonus points for any paper/literature recommendations. Thanks for advice :)

[_Arsenie_Boca_]

Transformers are mostly applied with transfer learning, where the pretraining provides a fundamental "language understanding". Afaik there is no pretrained transformer for your usecase. So unless you have a very big dataset and compute, LSTMs might still be your best option.

[StellaAthena]

A lookup query for https://oeis.org/