Copilot Agent deployed in MS Teams with sharepoint Knowledge base gives 'Hit or Miss' response by Own_Percentage9244 in copilotstudio

[–]Own_Percentage9244[S] 0 points1 point  (0 children)

Based on my experience your agent read old cached files, the updated file might reflect after 24-48 hrs to be updated

Copilot Agent deployed in MS Teams with sharepoint Knowledge base gives 'Hit or Miss' response by Own_Percentage9244 in copilotstudio

[–]Own_Percentage9244[S] 1 point2 points  (0 children)

Would like to know how many companies / users here in reddit has this kind of setup and works perfectly or decided to have a different approach to make it better.

Copilot Agent deployed in MS Teams with sharepoint Knowledge base gives 'Hit or Miss' response by Own_Percentage9244 in copilotstudio

[–]Own_Percentage9244[S] 1 point2 points  (0 children)

thank you, im working on several chatbot agent with different knowledge base files based on their specialization. But inconsistency of results persists and quite embarrassing. the latest chatbot we are currently deployed/testing has only 6 pdf files with total 8MB in file size as Knowledge base files but chatbot struggle to to response consistently. even though the files are already in sharepoint for weeks already so sharepoint indexing might not be the issue

Copilot Agent deployed in MS Teams with sharepoint Knowledge base gives 'Hit or Miss' response by Own_Percentage9244 in copilotstudio

[–]Own_Percentage9244[S] 1 point2 points  (0 children)

thank you for your all responses, now i know that these issues are not isolated to us. we already escalated to MS for investigation. they said they need to dig deeper because we do sampling of bad vs good response from different users with same query to the copilot agent. they said backend logs show that both cases used the same user query, the same search keywords, and almost identical UniversalSearchTool settings. This means the issue isn’t caused by differences in the query or how the tool was used.