Create Batch

OverviewCopy Anchor Link

Upload a JSONL file with purpose=batch, then use its ID as input_file_id. Completed batches return output and error file IDs.

NotesCopy Anchor Link

• Batch input files must use purpose=batch.
• completion_window is currently 24h.
• Output order may differ from input order. Match each result by custom_id.
• Streaming is not supported inside batch items.
• Supported item endpoints are /v1/chat/completions and /v1/embeddings. /v1/responses is not supported.

ExampleCopy Anchor Link

curl -X POST "https://api.tokenlab.sh/v1/batches" \
  -H "Authorization: Bearer sk-your-api-key" \
  -H "Content-Type: application/json" \
  -d '{
    "input_file_id": "file_abc123",
    "endpoint": "/v1/chat/completions",
    "completion_window": "24h"
  }'

Batch prices may differ from synchronous requests. Use the price shown when creating the batch and the final bill.

{
  "id": "batch_abc123",
  "object": "batch",
  "endpoint": "/v1/chat/completions",
  "input_file_id": "file_abc123",
  "completion_window": "24h",
  "status": "validating",
  "output_file_id": null,
  "error_file_id": null,
  "created_at": 1706000000
}

Important fieldsCopy Anchor Link