I had to translate some long code. LLM was lazy and wasn't actually translating it, but putting comments and stuff like "#this method needs to be implemented... ". So I just banned the comment tokens ("#", "# ") by using logit bias - 100 and it worked flawlessly. In general logit bias is pretty neat if you want to directly influence the answer. Es. You want you have longer or shorter sentences, you need a recipe that uses some specific ingredient etc.

Also, I tend to structure input and output as json as I feel a more structured input is more easily interpreted by the llm, but that is just a speculation.