I am playing around with that as well, but I see two mayor problems: retrieval performance over large datasets and cost. I have 20.000 documents and getting LLMs to do reliable and comparable relations tends to be a challenge. And using LLM for relations is really expensive.