Get test set prompt template

curl --request GET \
  --url https://api.trymaitai.ai/api/v1/test-sets/{test_set_id}/prompt-template \
  --header 'X-Maitai-Api-Key: <api-key>'

{
  "data": {
    "eligible": true,
    "reason": "<string>",
    "details": {
      "shape_distribution": [
        {}
      ]
    },
    "template": {
      "messages": [
        {
          "role": "<string>",
          "content": "<string>",
          "template_regex": {},
          "template_regex_optional": [
            "<string>"
          ]
        }
      ],
      "pass_through_indices": [
        123
      ]
    },
    "sample_bindings": [
      {}
    ],
    "request_count_considered": 123,
    "test_set_total_requests": 123
  }
}

Test Sets

Get test set prompt template

Infer the prompt template a test run would apply across this test set. Returns the inferred per-message template (literal text plus {{var_N}} placeholders), regexes used to extract per-request values from each captured request, and a small slice of sample variable bindings. Use this to discover what an LLM agent (or any caller) can tweak before creating a test run: edit the returned template.messages[i].content (keeping the {{var_N}} placeholders) and pass the edited template into config.prompt_template on POST /v1/test-runs. Optional query param sample_limit (1-500, default 200) caps the number of captured requests scanned during inference. When the test set’s captured requests have non-uniform message shapes, the response is {"eligible": false, "reason": "...", "details": {...}} and templating is unavailable for that test set.

GET

test-sets

{test_set_id}

prompt-template

Get test set prompt template

curl --request GET \
  --url https://api.trymaitai.ai/api/v1/test-sets/{test_set_id}/prompt-template \
  --header 'X-Maitai-Api-Key: <api-key>'

{
  "data": {
    "eligible": true,
    "reason": "<string>",
    "details": {
      "shape_distribution": [
        {}
      ]
    },
    "template": {
      "messages": [
        {
          "role": "<string>",
          "content": "<string>",
          "template_regex": {},
          "template_regex_optional": [
            "<string>"
          ]
        }
      ],
      "pass_through_indices": [
        123
      ]
    },
    "sample_bindings": [
      {}
    ],
    "request_count_considered": 123,
    "test_set_total_requests": 123
  }
}

Authorizations

X-Maitai-Api-Key

string

header

required

Your Maitai API key from the Portal.

Path Parameters

test_set_id

integer

required

Response

200 - application/json

Get test set prompt template.

data

object

Inferred prompt template for a test set, ready to be tweaked and forwarded into Config.prompt_template on POST /v1/test-runs. When the test set's captured requests have non-uniform message shapes, only eligible, reason, details, request_count_considered, and test_set_total_requests are populated.

Show child attributes

Convert workflow test set to requests List test runs

⌘I