Create Evaluation Set Items

import { ExtendClient, ExtendEnvironment } from "extend-ai";
async function main() {
    const client = new ExtendClient({
        environment: ExtendEnvironment.Production,
        token: "YOUR_TOKEN_HERE",
    });
    await client.evaluationSetItems.create("evaluation_set_id_here", {
        items: [
            {
                fileId: "file_xK9mLPqRtN3vS8wF5hB2cQ",
                expectedOutput: {
                    value: {
                        "vendor_name": "Acme Corp",
                        "invoice_number": "INV-001",
                        "total_amount": 1500,
                    },
                },
            },
        ],
    });
}
main();

{
  "evaluationSetItems": [
    {
      "object": "evaluation_set_item",
      "id": "evi_kR9mNP12Qw4yTv8BdR3H",
      "evaluationSetId": "ev_2LcgeY_mp2T5yPaEuq5Lw",
      "file": {
        "object": "file",
        "id": "file_xK9mLPqRtN3vS8wF5hB2cQ",
        "name": "Invoices.pdf",
        "type": "PDF",
        "parentFileId": "file_Zk9mNP12Qw4yTv8BdR3H",
        "metadata": {
          "pageCount": 30,
          "parentSplit": {
            "id": "string",
            "type": "Invoice",
            "identifier": "other_2_9",
            "startPage": 1,
            "endPage": 10
          }
        },
        "createdAt": "2024-03-21T16:45:00Z",
        "updatedAt": "2024-03-21T16:45:00Z"
      },
      "expectedOutput": {
        "value": {}
      }
    }
  ]
}

Limit: You can create up to 100 items at a time.

Learn more about how to create evaluation set items in the Evaluation Sets product page.

Evaluation set items are the individual files and expected outputs that are used to evaluate the performance of a given extractor, classifier, or splitter in Extend. This endpoint will create new evaluation set items in Extend, which will be used during an evaluation run. **Limit:** You can create up to 100 items at a time. Learn more about how to create evaluation set items in the [Evaluation Sets](https://docs.extend.ai/2026-02-09/product/evaluation/overview) product page.

Authentication

AuthorizationBearer

Bearer authentication of the form Bearer <token>, where token is your auth token.

Path parameters

evaluationSetIdstringRequired

The ID of the evaluation set.

Example: "ev_2LcgeY_mp2T5yPaEuq5Lw"

Request

This endpoint expects an object.

itemslist of objectsRequired

An array of objects representing the evaluation set items to create.

Response

Evaluation set items created successfully

evaluationSetItemslist of objects

Create Evaluation Set Items

Authentication

Path parameters

Headers

Request

Response

Errors