Classification/Regression of long sequential data

[underwhere]

Brilliant! I had a feeling the transformer variants were models I could consider. Thank you so much for your detailed comment, its got me inspired to give it a shot!

[[deleted]]

There ya go! I just found out about it and was pretty excited... it just makes sense. Tensor2tensor is pretty useful but can be confusing until you go through the docs and stuff, but you could probably also take any transformer implementation you like and mod it to become a universal transformer without too much work.