Skip to main content
All CollectionsHelp Center
Quilt Best Practices: How will Quilt’s answers improve?
Quilt Best Practices: How will Quilt’s answers improve?

Quilt’s answers will improve over time on their own as you answer more questions, give our system more feedback, and as we work behind the scenes to improve the quality of knowledge that Quilt has.

P
Written by Polina Vishnevskaya
Updated over 3 months ago

Reminder: Quilt’s answers are meant to be a first pass at a questionnaire, and not the final approved answer. Please be sure to review ALL Quilt answers before submitting to a customer!!

What do we do for you?

As part of our service to you, we will:

  • Re-index your docs on request to refresh your knowledge sources (DM Dan in Slack or email [email protected])

  • Monitor your answer quality to and continue to tune our AI

  • Spot-test answers to make sure answer quality stays high

  • Continue to push improvements to our answer engine

  • Report on answer accuracy (email [email protected] to request)

How can you help?

Answers are not going to be 100% correct, but we’ve implemented some systems so you can help it improve. This is all optional but recommended!

  1. Review the questionnaires and update incorrect answers as you get them.

  2. When you are done with a questionnaire in Quilt, upload the reviewed questionnaire back into your Answer Bank in Quilt.

  3. Use the thumbs up and thumbs down reactions to Quilt’s output in Knowledge Assistant and Search.

  4. Update your source documents and Answer Bank to ensure your references remain relevant.

  5. If Quilt says “unable to answer”, upload a doc that contains the answer. To minimize hallucinations, we only answer from the information you give us!

  6. Let us know when answers are wrong! We would love to help you. Upvote or downvote an answer, DM Daniel or Polina in Slack, or post in the shared Slack Connect channel.

How to evaluate Quilt answers?

Help us improve your experience in the long-term. Here are some questions that could help refine what you may be struggling with and some immediate actions you can take to resolve that.

In any case, please feel free to contact us even if you are able to diagnose or resolve the issue yourself.

Diagnosis

How would you know?

What can you do?

Technical bug

Unexpected output (or lack thereof)

Contact us via Slack

Lack of references

The answer is incorrect or unable to answer, and searching 1 or 2 keywords from the query yields “unable to answer” or no relevant results

Upload the relevant documentation and rerun the questionnaire

Irrelevant references

The answer is incorrect, but searching for keywords from the query or rephrasing the question yields expected results

Consider whether the referenced documents need updating.

Consider whether the query used the same terminology as the documentation.

Synthesis error

The references seem appropriate, but we still came up with the wrong answer

Contact us via Slack

How to take advantage of Quilt’s functionality?

Here are some questions you may have about using Quilt. You can explore them in more detail by following the links below.

Did this answer your question?