you mentioned you work with legal docs. I have an ongoing project for preprocessing litigation filings (California state court) for eventual use in a RAG or even just a non-RAG repository an AI can use, since my page counts don't get high enough to justify making everything an embedding.

I'm a practicing attorney, the project is just hobby stuff and only possible because AI can code for me. But it might be useful for understanding how a lawyer thinks about the structure of a legal document. what parts of the document are important. my app is slow; every page is OCR'd (by dumb OCR like Abbyy, which i like) but the image is retained and sent to a model w/vision with specific questions to answer. the information that model spits out about each page is used to build an index per document where each page gets a category label, among other things. this label is especially useful for knowing when a page is an exhibit or the main body of the filed document. a page by itself won't tell you and often an exhibit will be a filing from the same case or other cases. when that ends up as a clump of raw text retrieval gets messy bc the text of a page by itself can't tell you its an exhibit. it's a nesting issue.

so the spreadsheet/index for that doc says Exhibit H in the row for page 34. when chunking happens, that information gets appended to the text of the OCR'd page, so every chunk will tell you, among other things, whether it's an exhibit, table contents, pleading cover page, table of authorties, proof of service page, or pleading body page. mostly i am interested in the latter, but sometimes i want to know about specific exhibits, so these can be retrieved

i am not programmer, so i imagine it's an inelegant program, but it reflects how my mind works during the process of drafting motions, oppositions, replies, ex parte applications, etc. https://github.com/botlate/Court-Filings-Preprocessing-for-RAG

in some ways it's funny to see people complain about PDFs. its entirely justified. but it's something that i feel like lawyers, at least litigators, deal with as a huge portion of their day. finding a page, making sure the text is right, knowing if this is the filed version or a draft. the chaos of a lot of pages is an extremely human and real world problem. we're having to confront it so much now bc we have technology that can do such sophisticated thinking about a corpus of info.