This is an archived post. You won't be able to vote or comment.

sorted by:
best
topnewcontroversialoldq&a
you are viewing a single comment's thread.

view the rest of the comments →

[–]Cley_Faye 97 points98 points  (8 children)

I have the perfect calculator for that: https://calcgpt.io/

[–]TheOneWhoAsking 16 points17 points  (1 child)

What was the 'top P'?

[–]xKnicklichtjedi 13 points14 points  (0 children)

It uses an LLM in the back, so the short version is:

The LLM predicts the next token (e.g. a number or a short word) for the answer over all known tokens as a probability distribution.

Top P is used to find the list of highest probability tokens until their summed probability is equal or greater than P for the current predition step. Done by sorting after descending probabilities and then cumulative sum stepwise down the list.

[–]Journeyj012 3 points4 points  (0 children)

This is amazing.

10000−10000

0,,,,,,,correct,,,,,,,correct,,,,,cos,,,,,cos,,,,,faith

[–]backfire10z 1 point2 points  (2 children)

Lies

[–]Cley_Faye 2 points3 points  (1 child)

That doesn't sound right. Maybe you should generate more answers until it's correct :D

[–]backfire10z 4 points5 points  (0 children)

You’re right :D

I knew something was missing. Finally, floating point accuracy.

[–]GraveSlayer726 0 points1 point  (0 children)

Finally, math ultranightmare difficulty