For AI agents: a documentation index is available at the root level at /llms.txt and /llms-full.txt. Append /llms.txt to any URL for a page-level index, or .md for the markdown version of any page.
Book a demoLog in
ProductAPI ReferenceChangelogModel Versioning
ProductAPI ReferenceChangelogModel Versioning
    • Authentication
    • API Versioning
  • Workflow Endpoints
    • Run Workflow
    • Workflow Run
    • List Workflow Runs
    • Update Workflow Run
    • Create Workflow
    • Batch Run Workflow
    • Correct Workflow Run (Deprecated)
  • Processor Endpoints
    • Run Processor
    • Get Processor Run
    • Batch Processor Run
    • Create Processor
    • Update Processor
    • Publish Processor Version
    • Processor Version
    • List Processor Versions
  • Parse Endpoints
    • Parse File
  • File Endpoints
    • Upload File
    • Get File
    • List Files
    • Create File (Deprecated)
  • Evaluation Set Endpoints
    • Create Evaluation Set
    • Create Evaluation Set Item
    • Update Evaluation Set Item
    • Bulk Create Evaluation Set Item
  • Objects
    • Block
    • Evaluation Set
    • Evaluation Set Item
    • File
    • Processor
    • Processor Run
    • Batch Processor Run
    • Processor Version
    • Workflow
    • Workflow Run
    • Workflow Run Summary
  • Guides
    • Processor Configs
    • Output Types
    • Bounding Boxes
    • Supported File Types
    • Rate Limits
    • User Roles and Permissions
  • Webhooks
    • Configuration
    • Events
LogoLogo
Book a demoLog in
Evaluation Set Endpoints

Bulk Create Evaluation Set Items

Create evaluation set items for a given evaluation set in bulk.
1curl --request POST \
2  --url https://api-prod.extend.app/evaluation_set_items/bulk \
3  --header 'Authorization: Bearer <token>' \
4  --header 'Content-Type: application/json' \
5  --data '{
6  "evaluationSetId": "<string>",
7  "items": [
8    {}
9  ]
10}'
Example Response
1{
2  "success": true,
3  "evaluationSetItems": [
4    {
5      "object": "evaluation_set_item",
6      "id": "eval_item_1234",
7      "evaluationSetId": "eval_set_1234",
8      "fileId": "file_1234",
9      "expectedOutput": {
10        // Output object - see “Processor output types” for details
11      },
12      "createdAt": "2024-01-01T00:00:00Z",
13      "updatedAt": "2024-01-01T00:00:00Z"
14    },
15    {
16      "object": "evaluation_set_item",
17      "id": "eval_item_5678",
18      "evaluationSetId": "eval_set_5678",
19      "fileId": "file_5678",
20      "expectedOutput": {
21        // Output object - see “Processor output types” for details
22      },
23      "createdAt": "2024-01-01T00:00:00Z",
24      "updatedAt": "2024-01-01T00:00:00Z"
25    }
26  ]
27}
Was this page helpful?
Previous

The Block Object

Detailed information about the Block object structure and types returned by the /parse API endpoint.

Next
Built with

If you have a large number of files that you need to add to an evaluation set, you can use this endpoint to create multiple evaluation set items at once. This can be useful if you have a large dataset that you need to evaluate the performance of a processor against.

Note: you still need to create each File first using the file API.

Body

evaluationSetId
stringRequired

The ID of the evaluation set to add the items to.

items
arrayRequired

An array of objects representing the evaluation set items to create. Each object should have the following fields:

properties
fileId
string

The ID of the file to add to the evaluation set.

expectedOutput
object

The expected output of the processor when run against the file. This should be a JSON object conforming to the output type schema of the processor.

Response

boolean

A true or false value for whether the evaluation set items were created successfully or not.

array

An array of EvaluationSetItem objects representing the newly created evaluation set items. See the EvaluationSetItem object for more details.