Skip to main content
All CollectionsHelp Center
How to interpret Quilt's confidence scores?
How to interpret Quilt's confidence scores?

Knowing if Quilt's answers are accurate with confidence scores.

Michael Graczyk avatar
Written by Michael Graczyk
Updated over 3 weeks ago

When Quilt is unsure about whether it can provide an answer given the references, it will either refuse to answer or give an answer, caveating it with a low confidence scores. This could happen because:

  • The answer is incorrect

  • The answer would not address all parts of the question

  • The answer would mention the references

  • The answer is not written in the SE style

  • More than one of the above

The goal is to flag a potentially bad answer earlier on, saving you time you have to look for it yourself.

When seeing a low confidence score badge:

  1. If the answer is good, give it a thumbs up and save it to the answer bank. Quilt will keep it in mind when responding to future questions.

  2. If the answer is not good, review the potential reasons. Some concrete steps you can take:

    1. Review the references shown under the response. Did Quilt look at the right documents? Are the documents up-to-date?

    2. Review the source documents and the answer bank. Did Quilt have the data to answers those questions?

    3. Downvote the answer. This will help us make Quilt better for your use cases.

Did this answer your question?