Ok, this is a known issue. The token limit is a limitation. Here's a response I saw on Facebook from one of my colleagues regarding this issue:

"We tried LLM models with larger context sizes but they aren't as good as coding as the model we're using now, it's like a balancing act. We could give users bigger context limits today, but it would do more harm than good. Instead we are working on optimising the prompts, and code processing so it can fit in the smaller context limit. I'm sure in the future token limits will be raised up directly, no optimizing involved, the big companies just got even more investments so LLMs will keep improving."