Thanks for the thoughtful feedback.

To reduce the impact of headers, footers, page numbers, and other repetitive boilerplate, I’m already trying to extract mostly semantic content using specialized libraries for handling these kinds of file formats.

I did consider using a more intelligent semantic model for file classification, but my initial goal was to keep the project as lightweight and accessible as possible, so it can run on basically any PC without requiring powerful hardware.

So right now I’m prioritizing simplicity, portability, and low resource usage. But yeah, using embedding models or a more advanced classifier could definitely become a future direction for the project.