Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

BUG: when Docq doesn't know the answer it still references a source #202

Open
janaka opened this issue Jan 24, 2024 · 1 comment
Open

BUG: when Docq doesn't know the answer it still references a source #202

janaka opened this issue Jan 24, 2024 · 1 comment
Assignees
Labels
bug Something isn't working

Comments

@janaka
Copy link
Contributor

janaka commented Jan 24, 2024

Problem

When the LLM responds that it doesn't know the answer to the question a source(s) are still referenced.

At present sources seems to be listed based on what's retrieved rather than what was used in the answer.

Recreate

Create a new chat thread. upload a file. Ask a question that the file would not have the info about.

Desired Behaviour

  • When the response states it doesn't know the answer, there shouldn't be any source referenced.
  • Even when the answer is given, only the sources that were used in the answer should be listed.
@janaka janaka added the bug Something isn't working label Feb 4, 2024
@janaka
Copy link
Contributor Author

janaka commented Apr 30, 2024

The cause of this is most like that retrieval is returning nodes and they are blindly being referenced as sources. We probably need extra logic to not to render sources if the LLM response is borked.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
bug Something isn't working
Projects
None yet
Development

When branches are created from issues, their pull requests are automatically linked.

2 participants