EvaluationsResource

Evaluation API methods.

Functions

func__init__(self, client) -> None

Initialize the resource.

paramself

paramclientKitaruAPIClient

API client used to send requests.

Returns

None

funccreate(self, request, idempotency_key=None) -> JobResponse

Score every input session with every evaluator.

paramself

paramrequestEvaluationBatchCreateRequest

Evaluation batch create request.

paramidempotency_keystr | None

= None

Idempotency key overriding the transport's random default.

Returns

kitaru.api_models.v1.job.JobResponse

Created job.

funcget(self, evaluation_id) -> EvaluationResponse

Get an evaluation by id.

paramself

paramevaluation_iduuid.UUID

Id of the evaluation.

Returns

kitaru.api_models.v1.evaluation.EvaluationResponse

Stored evaluation.

funclist(self, params=None) -> Page[EvaluationResponse]

List evaluations.

paramself

paramparamsEvaluationListParams | None

= None

Evaluation list params.

Returns

kitaru.api_models.v1.base.Page

Page of evaluations.

funciter(self, params=None) -> AsyncIterator[EvaluationResponse]

Iterate over all evaluations.

paramself

paramparamsEvaluationListParams | None

= None

Evaluation list params.

Returns

collections.abc.AsyncIterator

Async iterator over every evaluation.