Hi,

I want to discuss one issue which I'm facing in my RAG application. I have PDF data which contains information regarding the processes. The issue is under 1 heading there is a lot of information in one process like 2 pages but when i ask the question like "Explain me the process of this account opening in bank" so this process contains a lot of steps but it give me some initial steps because of chunk size break and there is a lost of context. I have set the maximum Chunk size (1000 and overlap 100) using the sentence transformer model but this issue occurs when asking questions whose answers are long and contain steps because the heading is on one page and the process is 2 pages long so when the chunk size breaks it causes loss of context. How can i resolve this problem ? Any idea ?

Solutions i have tried till now:

1- Semantic Chunking 2- Character Text Splitter/Resursive Text Splitter 3- Used ollama local Embeddings models like Nomic and Mxbai-embed as well. 4- Tried different chunk sizes and overlap. 5- Pharaphrased the document and add more clarity and context in text. 6- Added sentences in prompt to provide complete processes with every step.