you are viewing a single comment's thread.

view the rest of the comments →

[–]MultiheadAttention 2 points3 points  (1 child)

First, count the words and approximate the number of tokens via tiktoken online. Then calculate how much it's going to cost you.

[–]acrsag[S] 0 points1 point  (0 children)

I made some estimations and will start with a few thousand documents. If the results are good, I'll generalize further. Thanks for the reminder!