What is a mock verdict, and why does it say 'not a real evaluation'?

A mock verdict comes from the SDK's mock mode. It has the same shape as a real verdict, but the score is a local test value. Its summary says "Mock verdict for local/standalone use; not a real evaluation." It is never signed.

Last updated

Steps

  1. Make one

    import { createKernelClient } from '@clearrun/sdk';

const client = createKernelClient({ forceMock: true });
const { verdict } = await client.score({ responseText: 'Our API never stores customer data.' });
console.log(verdict);

  2. Read the signs that it is a mock

    • verdictId starts with mock_.
    • scoringVersion is mock-1.0.0.
    • signature, signatureKeyId and signatureAlg are null.
    • The summary says it is not a real evaluation.

Why mock scores exist

So you can build and test your code with no account and no network. Hosted scores work differently: a later run of the same text can score differently.

Why you should not act on them

The mock score depends only on the length of the text. It says nothing about the answer. For a real score, use a hosted call with an API key.