Test Agent Grader
Score an unsaved file with its own judge. Poll a pending test; no Grader or verdict is saved.
Authentication
AuthorizationBearer
Bearer authentication of the form Bearer <token>, where token is your auth token.
Path parameters
project_id
agent_id
Headers
Idempotency-Key
Request
This endpoint expects an object.
file
The Grader file’s text, as a push would read it. It is tested by its chosen judge without saving a Grader or verdict; its ceiling applies while its release check is on.
name
The Grader file’s name: graders/<name>.toml in the agent folder.
limit
Recent conversations to score.
Response
Successful Response
ceiling
conclusive
conversations
flagRate
flagged
results
Flagged first.
status
A pending test is still scoring; poll runId. A failed test is final: test again to start a new run.
Allowed values:
wouldBlock
The flag rate is above the ceiling.
error
Why a failed test could not finish.
runId
Errors
401
Unauthorized Error
402
Payment Required Error
403
Forbidden Error
404
Not Found Error
409
Conflict Error
422
Unprocessable Entity Error
503
Service Unavailable Error
