Create Evaluation Set Items

import { ExtendClient } from "extend-ai";
const client = new ExtendClient({ token: "YOUR_TOKEN" });
await client.evaluationSetItems.create("evaluation_set_id_here", {
    items: [{
            fileId: "file_xK9mLPqRtN3vS8wF5hB2cQ",
            expectedOutput: {
                value: {
                    "vendor_name": "Acme Corp",
                    "invoice_number": "INV-001",
                    "total_amount": 1500
                }
            }
        }]
});

{
  "evaluationSetItems": [
    {
      "object": "evaluation_set_item",
      "id": "evi_kR9mNP12Qw4yTv8BdR3H",
      "evaluationSetId": "ev_2LcgeY_mp2T5yPaEuq5Lw",
      "file": {
        "object": "file",
        "id": "file_xK9mLPqRtN3vS8wF5hB2cQ",
        "name": "Invoices.pdf",
        "type": "PDF",
        "parentFileId": "file_Zk9mNP12Qw4yTv8BdR3H",
        "metadata": {
          "pageCount": 30,
          "parentSplit": {
            "id": "string",
            "type": "Invoice",
            "identifier": "other_2_9",
            "startPage": 1,
            "endPage": 10
          }
        },
        "createdAt": "2024-03-21T16:45:00Z",
        "updatedAt": "2024-03-21T16:45:00Z"
      },
      "expectedOutput": {
        "value": {}
      }
    }
  ]
}

Evaluation set items are the individual files and expected outputs that are used to evaluate the performance of a given extractor, classifier, or splitter in Extend. This endpoint will create new evaluation set items in Extend, which will be used during an evaluation run. **Limit:** You can create up to 100 items at a time. Learn more about how to create evaluation set items in the [Evaluation Sets](https://docs.extend.ai/2026-02-09/product/evaluation/overview) product page.

import { ExtendClient } from "extend-ai";
const client = new ExtendClient({ token: "YOUR_TOKEN" });
await client.evaluationSetItems.create("evaluation_set_id_here", {
    items: [{
            fileId: "file_xK9mLPqRtN3vS8wF5hB2cQ",
            expectedOutput: {
                value: {
                    "vendor_name": "Acme Corp",
                    "invoice_number": "INV-001",
                    "total_amount": 1500
                }
            }
        }]
});

{
  "evaluationSetItems": [
    {
      "object": "evaluation_set_item",
      "id": "evi_kR9mNP12Qw4yTv8BdR3H",
      "evaluationSetId": "ev_2LcgeY_mp2T5yPaEuq5Lw",
      "file": {
        "object": "file",
        "id": "file_xK9mLPqRtN3vS8wF5hB2cQ",
        "name": "Invoices.pdf",
        "type": "PDF",
        "parentFileId": "file_Zk9mNP12Qw4yTv8BdR3H",
        "metadata": {
          "pageCount": 30,
          "parentSplit": {
            "id": "string",
            "type": "Invoice",
            "identifier": "other_2_9",
            "startPage": 1,
            "endPage": 10
          }
        },
        "createdAt": "2024-03-21T16:45:00Z",
        "updatedAt": "2024-03-21T16:45:00Z"
      },
      "expectedOutput": {
        "value": {}
      }
    }
  ]
}

Limit: You can create up to 100 items at a time.

Learn more about how to create evaluation set items in the Evaluation Sets product page.

Authentication

AuthorizationBearer

Bearer authentication of the form Bearer <token>, where token is your auth token.

Path parameters

evaluationSetIdstringRequired

The ID of the evaluation set.

Example: "ev_2LcgeY_mp2T5yPaEuq5Lw"

Headers

Request

This endpoint expects an object.

itemslist of objectsRequired

An array of objects representing the evaluation set items to create.

Response

Evaluation set items created successfully

evaluationSetItemslist of objects

Errors

400

Bad Request Error

401

Unauthorized Error

402

Payment Required Error

403

Forbidden Error

404

Not Found Error

422

Unprocessable Entity Error

429

Too Many Requests Error

500

Internal Server Error

1	import { ExtendClient } from "extend-ai";
2
3	const client = new ExtendClient({ token: "YOUR_TOKEN" });
4	await client.evaluationSetItems.create("evaluation_set_id_here", {
5	items: [{
6	fileId: "file_xK9mLPqRtN3vS8wF5hB2cQ",
7	expectedOutput: {
8	value: {
9	"vendor_name": "Acme Corp",
10	"invoice_number": "INV-001",
11	"total_amount": 1500
12	}
13	}
14	}]
15	});

1	{
2	"evaluationSetItems": [
3	{
4	"object": "evaluation_set_item",
5	"id": "evi_kR9mNP12Qw4yTv8BdR3H",
6	"evaluationSetId": "ev_2LcgeY_mp2T5yPaEuq5Lw",
7	"file": {
8	"object": "file",
9	"id": "file_xK9mLPqRtN3vS8wF5hB2cQ",
10	"name": "Invoices.pdf",
11	"type": "PDF",
12	"parentFileId": "file_Zk9mNP12Qw4yTv8BdR3H",
13	"metadata": {
14	"pageCount": 30,
15	"parentSplit": {
16	"id": "string",
17	"type": "Invoice",
18	"identifier": "other_2_9",
19	"startPage": 1,
20	"endPage": 10
21	}
22	},
23	"createdAt": "2024-03-21T16:45:00Z",
24	"updatedAt": "2024-03-21T16:45:00Z"
25	},
26	"expectedOutput": {
27	"value": {}
28	}
29	}
30	]
31	}