Bulk Create Evaluation Set Items

Create evaluation set items for a given evaluation set in bulk.

If you have a large number of files that you need to add to an evaluation set, you can use this endpoint to create multiple evaluation set items at once. This can be useful if you have a large dataset that you need to evaluate the performance of a processor against.

Note: you still need to create each File first using the file API.

Body

evaluationSetId
stringRequired

The ID of the evaluation set to add the items to.

items
arrayRequired

An array of objects representing the evaluation set items to create. Each object should have the following fields:

fileId
string

The ID of the file to add to the evaluation set.

expectedOutput
object

The expected output of the processor when run against the file. This should be a JSON object conforming to the output type schema of the processor.

Response

boolean

A true or false value for whether the evaluation set items were created successfully or not.

array

An array of EvaluationSetItem objects representing the newly created evaluation set items. See the EvaluationSetItem object for more details.