Create Evaluation Set Item
Evaluation set items are the individual files and expected outputs that are used to evaluate the performance of a given processor in Extend. This endpoint will create a new evaluation set item in Extend, which will be used during an evaluation run.
Best Practices for Outputs in Evaluation Sets:
- **Configure First, Output Later**
- Always create and finalize your processor configuration before creating evaluation sets
- Field IDs in outputs must match those defined in your processor configuration
- **Type Consistency**
- Ensure output types exactly match your processor configuration
- For example, if a field is configured as "currency", don't submit a simple number value
- **Field IDs**
- Use the exact field IDs from your processor configuration
- Create your own semantic IDs instead in the configs for each field/type instead of using the generated ones
- **Value**
- Remember that all results are inside the value key of a result object, except the values within nested structures.
Authentication
AuthorizationBearer
Bearer authentication of the form Bearer <token>, where token is your auth token.
Headers
x-extend-api-version
API version to use for the request. If you do not specify a version, you will either receive a 400 Bad Request or be set to a previous legacy version. See API Versioning for more details.
Request
This endpoint expects an object.
evaluationSetId
The ID of the evaluation set to add the item to.
Example: "ev_Xj8mK2pL9nR4vT7qY5wZ"
fileId
Extend’s internal ID for the file. It will always start with “file_”.
Example: "file_xK9mLPqRtN3vS8wF5hB2cQ"
expectedOutput
The expected output that will be used to evaluate the processor's performance.
Response
Successfully created evaluation set item
success
evaluationSetItem
The EvaluationSetItem object represents an item in an evaluation set in Extend. Items are the individual files and expected outputs that are used to evaluate the performance of a given processor in Extend.
