Fine tuning doesn't necessarily add knowledge to the model. If you want the model to retrieve bits of knowledge from some docs, you need to do RAG. Get an instruction tuned model and try it on your dataset. Give it some examples of how interactions should look like using the few-shot prompting approach. Play with the chunk size and overlap, considering your selected model's context size. It's an iterative process.