How is the ClearRun score calculated?

The scoring method is not published. The score is made by ClearRun's hosted service. The open npm packages call that service and do not contain the scoring method.

Last updated

What is public

  • The score runs from 0 to 100, or is null when ClearRun can't score the text.
  • Higher means the answer's confidence is better backed by its reasoning.
  • Paid results carry scoringVersion, a tag for the version of the hosted scorer that made it.
  • The field names and their meaning are public in the verdict contract.

What you can check

You can't recompute a score. A new score request is a new run, and its number may not match a stored score. You can check that ClearRun issued it, for that input, at that time. See How to verify a ClearRun receipt.

Sending the prompt

POST /api/evaluate accepts the prompt that produced the answer. Sending it gives ClearRun more context. See Why send the prompt with the answer.