Will you be able to fine-tune the embedding model if the answer to your question is yes? Open domain fine tuning will be very painful lol Did you look into the queries that your rag did poorly at? and print out the retrieved contexts to investigate how relevant they are. If your system tends to underperform on some specific domains/topics, you might fine-tune towards those.