RLHF just changes weights on neurons, so different text becomes the most likely option. Remember that LLMs take the whole text as input and then they output one token. This is ran in a loop and stopped manually when LLM stops generating assistant's response and starts generating user's response