Query Group method confidence signals
For the Query Group method, Sensible returns the following messages, or “confidence signals”, to qualify the LLM’s confidence in the accuracy of the extracted data.confidence signal | JSON output | description | troubleshooting |
---|---|---|---|
Multiple possible answers | multiple_possible_answers | The LLM answers the prompt, but identifies multiple possible answers in the context that Sensible provides to the LLM. | - To return multiple answers, use the List method. - To return a single answer, ensure the context contains a single answer. For more information, see Advanced prompt configuration. |
Answer might not fully answer the prompt | answer_may_be_incomplete | The LLM answers the prompt, but is uncertain whether the context that Sensible provides to the LLM contains the full answer. | - Simplify your prompt, for example, break it up into multiple prompts. - See Advanced prompt configuration. |
Answer not found in the context | answer_not_found | The LLM fails to answer the prompt, and can’t find an answer to your prompt in the context that Sensible provides to the LLM. | See Advanced prompt configuration. |
Ambiguous query | ambiguous_query | The LLM either answers or fails to answer your prompt, and identifies ambiguities in your prompt. | - Rephrase your prompt using the tips for each Instruct method. For example, see Query Group tips. - See Advanced prompt configuration. |
Incorrect answer | incorrect_answer | The LLM judges the answer is incorrect given the context that Sensible provides to the LLM. | See Advanced prompt configuration. |
Confident answer | confident_answer | The LLM is confident about its answer to the prompt. | |
Unknown signal | unknown_signal | The LLM returns a confidence signal other than the confidence signals Sensible instructs it to return. |