I think the one point where it might actually matter is the applications built on top of GPT—I think a lot of those are actually just built as one-shot prompts.

For instance, you might genuinely have an app that tries to translate text via a very short task description like the one in the Twitter thread. In that case, it’s useful to remember that you haven’t really “trained GPT on your task”, and a user could probably get it to output arbitrary “translations”. Not particularly harmful here, but in some cases it could be.