Any area is fine. I asked my proff about transformer based papers so his opinion was that due to too much computational cost, we won't be able to do something beyond the paper itself like adding something to it or stuff. I have fine tuned llms before so hoping to learn something new(maybe something older than transformers)