What does the honesty score mean?
The honesty score is a number from 0 to 100. It describes confidence-justification alignment: how well the confidence an answer projects matches the reasoning and evidence it gives.
Last updated
A higher score means the answer's confidence looks earned by what it shows. A lower score means the answer sounds more sure than its reasoning supports, or that the justification is thin. The score is not a measure of whether the answer is true, and it is not a quality, reliability, or accuracy rating.
What the score does not mean
- It does not mean ClearRun fact-checked the answer.
- It does not mean ClearRun detected a hallucination.
- It does not mean the answer is safe to trust without your own checks.
- Checking a hosted receipt later confirms that ClearRun issued that score for that input. It does not verify the AI answer itself.
What you get back
A hosted evaluation returns a verdict that includes the score, a short summary, and any flags ClearRun noted. Hosted evaluations are signed and receipted. Mock or unsigned paths, including local mock mode in the open kit, are not.