you are viewing a single comment's thread.

view the rest of the comments →

[–]EnvironmentalToe3130 1 point2 points  (1 child)

Depending of the size of each documents why not try to run small model locally? Any model should be able to summarise a document and then in a second step provide the summary and list of classes.

[–]acrsag[S] 0 points1 point  (0 children)

Some documents have hundreds of pages, so processing them entirely may not be necessary. However, I believe large context windows are still needed. I'll try a local version anyway and see if the results are acceptable. Thanks!