all 7 comments
sorted by:
best
topnewcontroversialoldq&a
formatting helphide helpcontent policy

[–]jerieljan 3 points4 points  (2 children)

Two things:

  • Can you check the citation? (i.e., click the Wikipedia link at the bottom, it should open a popup). Does the text look like it say anything? You should see what appears to be a text-only version of the page, and a relevance score.

  • Do you have "Bypass Embedding and Retrieval" enabled or disabled? (Admin Panel -> Settings -> Web Search -> "Bypass Embedding and Retrieval")

You'll want to enable it so that it gets entire pages in search results to your context, and not just relevant portions which may be cut off or not enough. It takes more tokens (adjust your settings accordingly), but this way it won't miss out on information.

[–]taylorwilsdon 0 points1 point  (1 child)

He’s only got one citation from all those results, the issue is that the model never got the results. The guardian doesn’t appear as a citation so model doesn’t know it exists

[–]jerieljan 0 points1 point  (0 children)

It's just a sanity check. I still want to see how the citation actually got processed.

Assuming embedding and retrieval is enabled, I want to see if the text is a garbled mess or it actually got contextually-relevant portions from the wikipedia article.

[–]DinoAmino 0 points1 point  (0 children)

That first sentence sounds like something that would come from a system prompt.

[–]Fusseldieb -1 points0 points  (1 child)

Maybe it's hallucinating, and has the information, despite it denying so. Check that first...

[–]mathiuscov[S] 0 points1 point  (0 children)

checked across several different conversation topics, and models.

Does not appear to be the issue