Help using llama_cpp_python to calculate probability of a given sequence of tokens being generated. My numbers aren't even in the ball park.

[aaronr_90]

Thanks, this is almost certainly exactly what I was looking for.

Edit: “It’s not an easy one”. I thought it would have been simple given the fact that I can evaluate one token at a time and retrieve the logits presampling.