How to score an answer with its prompt using clearrun_evaluate

Ask your assistant to run clearrun_evaluate with both the answer and the prompt that produced it. It calls POST /api/evaluate.

Last updated

Steps

  1. Give both parts

    "Use clearrun_evaluate. Prompt: <the question>. Answer: <the answer>."

  2. Read the result

    The same fields as clearrun_score: score, verdict and receipt.

Limits

The answer must be 10 to 100,000 characters.

Why add the prompt

See Why send the prompt with the answer (evaluate vs score).