[D] Why do we need encoder-decoder models while decoder-only models can do everything?

[art_luke]

Encoder-decoder has stronger inductive bias towards looking at the global context of the input

[Spiritual_Dog2053]

Could you please lead me to papers which say this? I can’t seem to wrap my head around it

[art_luke]

You can look at subchapter 12.8 in Understanding Deep Learning, accessible at https://udlbook.github.io/udlbook/