> This page is also available as Markdown: append .md to its URL. The full index of Sikaru docs is at https://docs.sikaru.ai/llms.txt. Code examples use only operations from the public API reference at https://docs.sikaru.ai/api-reference. # Create Job POST https://api.sikaru.ai/v1/projects/{project_id}/evaluation-jobs Content-Type: application/json Reference: https://docs.sikaru.ai/api-reference/evaluation-jobs/create-job ## Authentication - `Authorization` header (bearer token, required) — Bearer authentication of the form `Bearer `, where token is your auth token. ## Request ### Path parameters - `project_id` (string, required) ### Body (application/json) This endpoint expects a JobInput. - `evaluator` (string, required) - `requestId` (string, required) - `revision` (string, required) - `rubric` (string, required) - `targets` (list of TargetInput, required) - `environment` (enum, optional, default: production) - Allowed values: `production`, `staging`, `development` ## Response ### 202 Successful Response - `map from string to any` ## Errors ### 401 Unauthorized Error Missing or invalid credentials (`unauthenticated`). - `code` (string, required) — Stable machine code. Specific values: `insufficient_credits` (402): billing does not allow this request now; check your plan, credits and the agent's spending cap; `idempotency_conflict` (409): the idempotency key was already used for a different request, or for a file that was deleted; `concurrent_request` (409): another request is changing the same resource; send the same request again; `agent_disabled` (409): the agent is turned off; turn it on before starting new work; `release_unavailable` (409): the agent has no release that can run; `action_not_pending` (409): the tool call or approval is not waiting for this input: it already has an outcome, its run finished, it is handled by Sikaru, or it does not match a pending request; `not_retryable` (409): the run cannot be retried: it did not fail, its failure is not recoverable, or it failed too long ago; `branch_unavailable` (409): the session cannot be branched at that run; `record_invalid` (409): the retained record cannot be read; `state_conflict` (409): the request conflicts with the resource's current state; read it before trying again; `agent_capacity_full` (429): the agent's turn capacity is full; `agent_unavailable` (503): execution is switched off for this agent; `turn_delivery_pending` (503): the message was recorded but has not started; send it again with the same idempotency key; `execution_storage_unavailable` (503): session, file or workspace storage is unavailable right now; `storage_unavailable` (503): the storage behind this resource is unavailable right now; `trajectory_storage_unavailable` (503): retained run records cannot be read right now. Otherwise a status default: `bad_request` (400), `unauthenticated` (401), `payment_required` (402), `forbidden` (403), `not_found` (404), `method_not_allowed` (405), `not_acceptable` (406), `request_timeout` (408), `conflict` (409), `gone` (410), `length_required` (411), `precondition_failed` (412), `payload_too_large` (413), `unsupported_media_type` (415), `range_not_satisfiable` (416), `invalid_request` (422), `locked` (423), `precondition_required` (428), `rate_limited` (429), `internal_error` (500), `not_implemented` (501), `bad_gateway` (502), `service_unavailable` (503), `gateway_timeout` (504). `429` and `503` refusals with a specific code carry `Retry-After` in seconds. - `detail` (string, required) ### 403 Forbidden Error The credential lacks access or a required scope (`forbidden`). - `code` (string, required) — Stable machine code. Specific values: `insufficient_credits` (402): billing does not allow this request now; check your plan, credits and the agent's spending cap; `idempotency_conflict` (409): the idempotency key was already used for a different request, or for a file that was deleted; `concurrent_request` (409): another request is changing the same resource; send the same request again; `agent_disabled` (409): the agent is turned off; turn it on before starting new work; `release_unavailable` (409): the agent has no release that can run; `action_not_pending` (409): the tool call or approval is not waiting for this input: it already has an outcome, its run finished, it is handled by Sikaru, or it does not match a pending request; `not_retryable` (409): the run cannot be retried: it did not fail, its failure is not recoverable, or it failed too long ago; `branch_unavailable` (409): the session cannot be branched at that run; `record_invalid` (409): the retained record cannot be read; `state_conflict` (409): the request conflicts with the resource's current state; read it before trying again; `agent_capacity_full` (429): the agent's turn capacity is full; `agent_unavailable` (503): execution is switched off for this agent; `turn_delivery_pending` (503): the message was recorded but has not started; send it again with the same idempotency key; `execution_storage_unavailable` (503): session, file or workspace storage is unavailable right now; `storage_unavailable` (503): the storage behind this resource is unavailable right now; `trajectory_storage_unavailable` (503): retained run records cannot be read right now. Otherwise a status default: `bad_request` (400), `unauthenticated` (401), `payment_required` (402), `forbidden` (403), `not_found` (404), `method_not_allowed` (405), `not_acceptable` (406), `request_timeout` (408), `conflict` (409), `gone` (410), `length_required` (411), `precondition_failed` (412), `payload_too_large` (413), `unsupported_media_type` (415), `range_not_satisfiable` (416), `invalid_request` (422), `locked` (423), `precondition_required` (428), `rate_limited` (429), `internal_error` (500), `not_implemented` (501), `bad_gateway` (502), `service_unavailable` (503), `gateway_timeout` (504). `429` and `503` refusals with a specific code carry `Retry-After` in seconds. - `detail` (string, required) ### 404 Not Found Error The resource or route does not exist (`not_found`). - `code` (string, required) — Stable machine code. Specific values: `insufficient_credits` (402): billing does not allow this request now; check your plan, credits and the agent's spending cap; `idempotency_conflict` (409): the idempotency key was already used for a different request, or for a file that was deleted; `concurrent_request` (409): another request is changing the same resource; send the same request again; `agent_disabled` (409): the agent is turned off; turn it on before starting new work; `release_unavailable` (409): the agent has no release that can run; `action_not_pending` (409): the tool call or approval is not waiting for this input: it already has an outcome, its run finished, it is handled by Sikaru, or it does not match a pending request; `not_retryable` (409): the run cannot be retried: it did not fail, its failure is not recoverable, or it failed too long ago; `branch_unavailable` (409): the session cannot be branched at that run; `record_invalid` (409): the retained record cannot be read; `state_conflict` (409): the request conflicts with the resource's current state; read it before trying again; `agent_capacity_full` (429): the agent's turn capacity is full; `agent_unavailable` (503): execution is switched off for this agent; `turn_delivery_pending` (503): the message was recorded but has not started; send it again with the same idempotency key; `execution_storage_unavailable` (503): session, file or workspace storage is unavailable right now; `storage_unavailable` (503): the storage behind this resource is unavailable right now; `trajectory_storage_unavailable` (503): retained run records cannot be read right now. Otherwise a status default: `bad_request` (400), `unauthenticated` (401), `payment_required` (402), `forbidden` (403), `not_found` (404), `method_not_allowed` (405), `not_acceptable` (406), `request_timeout` (408), `conflict` (409), `gone` (410), `length_required` (411), `precondition_failed` (412), `payload_too_large` (413), `unsupported_media_type` (415), `range_not_satisfiable` (416), `invalid_request` (422), `locked` (423), `precondition_required` (428), `rate_limited` (429), `internal_error` (500), `not_implemented` (501), `bad_gateway` (502), `service_unavailable` (503), `gateway_timeout` (504). `429` and `503` refusals with a specific code carry `Retry-After` in seconds. - `detail` (string, required) ### 422 Unprocessable Entity Error Validation Error - `detail` (list of ValidationError, optional) ## Types ### TargetInput - `target` (JudgmentTarget, required) - `traceId` (string, required) ### ValidationError - `loc` (list of ValidationErrorLocItems, required) - `msg` (string, required) - `type` (string, required) - `ctx` (ValidationErrorCtx, optional) - `input` (any, optional) ### JudgmentTarget - `accountId` (string, required) - `kind` (enum, required) - Allowed values: `message`, `span` - `conversationId` (string, optional, nullable) - `messageId` (string, optional, nullable) - `spanId` (string, optional, nullable) ### ValidationErrorLocItems - string - integer ### ValidationErrorCtx ## Examples **Request** ```json { "evaluator": "string", "requestId": "string", "revision": "string", "rubric": "string", "targets": [ { "target": { "accountId": "string", "kind": "message" }, "traceId": "string" } ] } ``` **Response** ```json {} ``` **SDK Code** ```python import requests url = "https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs" payload = { "evaluator": "string", "requestId": "string", "revision": "string", "rubric": "string", "targets": [ { "target": { "accountId": "string", "kind": "message" }, "traceId": "string" } ] } headers = { "Authorization": "Bearer ", "Content-Type": "application/json" } response = requests.post(url, json=payload, headers=headers) print(response.json()) ``` ```javascript const url = 'https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs'; const options = { method: 'POST', headers: {Authorization: 'Bearer ', 'Content-Type': 'application/json'}, body: '{"evaluator":"string","requestId":"string","revision":"string","rubric":"string","targets":[{"target":{"accountId":"string","kind":"message"},"traceId":"string"}]}' }; try { const response = await fetch(url, options); const data = await response.json(); console.log(data); } catch (error) { console.error(error); } ``` ```go package main import ( "fmt" "strings" "net/http" "io" ) func main() { url := "https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs" payload := strings.NewReader("{\n \"evaluator\": \"string\",\n \"requestId\": \"string\",\n \"revision\": \"string\",\n \"rubric\": \"string\",\n \"targets\": [\n {\n \"target\": {\n \"accountId\": \"string\",\n \"kind\": \"message\"\n },\n \"traceId\": \"string\"\n }\n ]\n}") req, _ := http.NewRequest("POST", url, payload) req.Header.Add("Authorization", "Bearer ") req.Header.Add("Content-Type", "application/json") res, _ := http.DefaultClient.Do(req) defer res.Body.Close() body, _ := io.ReadAll(res.Body) fmt.Println(res) fmt.Println(string(body)) } ``` ```ruby require 'uri' require 'net/http' url = URI("https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs") http = Net::HTTP.new(url.host, url.port) http.use_ssl = true request = Net::HTTP::Post.new(url) request["Authorization"] = 'Bearer ' request["Content-Type"] = 'application/json' request.body = "{\n \"evaluator\": \"string\",\n \"requestId\": \"string\",\n \"revision\": \"string\",\n \"rubric\": \"string\",\n \"targets\": [\n {\n \"target\": {\n \"accountId\": \"string\",\n \"kind\": \"message\"\n },\n \"traceId\": \"string\"\n }\n ]\n}" response = http.request(request) puts response.read_body ``` ```java import com.mashape.unirest.http.HttpResponse; import com.mashape.unirest.http.Unirest; HttpResponse response = Unirest.post("https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs") .header("Authorization", "Bearer ") .header("Content-Type", "application/json") .body("{\n \"evaluator\": \"string\",\n \"requestId\": \"string\",\n \"revision\": \"string\",\n \"rubric\": \"string\",\n \"targets\": [\n {\n \"target\": {\n \"accountId\": \"string\",\n \"kind\": \"message\"\n },\n \"traceId\": \"string\"\n }\n ]\n}") .asString(); ``` ```php request('POST', 'https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs', [ 'body' => '{ "evaluator": "string", "requestId": "string", "revision": "string", "rubric": "string", "targets": [ { "target": { "accountId": "string", "kind": "message" }, "traceId": "string" } ] }', 'headers' => [ 'Authorization' => 'Bearer ', 'Content-Type' => 'application/json', ], ]); echo $response->getBody(); ``` ```csharp using RestSharp; var client = new RestClient("https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs"); var request = new RestRequest(Method.POST); request.AddHeader("Authorization", "Bearer "); request.AddHeader("Content-Type", "application/json"); request.AddParameter("application/json", "{\n \"evaluator\": \"string\",\n \"requestId\": \"string\",\n \"revision\": \"string\",\n \"rubric\": \"string\",\n \"targets\": [\n {\n \"target\": {\n \"accountId\": \"string\",\n \"kind\": \"message\"\n },\n \"traceId\": \"string\"\n }\n ]\n}", ParameterType.RequestBody); IRestResponse response = client.Execute(request); ``` ```swift import Foundation let headers = [ "Authorization": "Bearer ", "Content-Type": "application/json" ] let parameters = [ "evaluator": "string", "requestId": "string", "revision": "string", "rubric": "string", "targets": [ [ "target": [ "accountId": "string", "kind": "message" ], "traceId": "string" ] ] ] as [String : Any] let postData = JSONSerialization.data(withJSONObject: parameters, options: []) let request = NSMutableURLRequest(url: NSURL(string: "https://api.sikaru.ai/v1/projects/project_id/evaluation-jobs")! as URL, cachePolicy: .useProtocolCachePolicy, timeoutInterval: 10.0) request.httpMethod = "POST" request.allHTTPHeaderFields = headers request.httpBody = postData as Data let session = URLSession.shared let dataTask = session.dataTask(with: request as URLRequest, completionHandler: { (data, response, error) -> Void in if (error != nil) { print(error as Any) } else { let httpResponse = response as? HTTPURLResponse print(httpResponse) } }) dataTask.resume() ```