# Maitai ## Docs - [Add sub agent](https://docs.trymaitai.com/api-reference/agents/add-sub-agent.md): Attach an existing agent as a sub-agent of a parent agent. - [Create agent](https://docs.trymaitai.com/api-reference/agents/create-agent.md): Create a new agent under an application. Requires `application_id` and `agent_name`. - [Create agent action](https://docs.trymaitai.com/api-reference/agents/create-agent-action.md): Add a new action (LLM, API, or webhook capability) to an agent. - [Create routing rule](https://docs.trymaitai.com/api-reference/agents/create-routing-rule.md): Create a new conditional routing rule for an agent. - [Delete agent](https://docs.trymaitai.com/api-reference/agents/delete-agent.md): Permanently delete an agent and its actions. - [Delete agent action](https://docs.trymaitai.com/api-reference/agents/delete-agent-action.md): Permanently remove an action from an agent. - [Delete agent release](https://docs.trymaitai.com/api-reference/agents/delete-agent-release.md): Remove a named release. - [Delete form fields](https://docs.trymaitai.com/api-reference/agents/delete-form-fields.md): Remove all form fields from an agent, clearing its input form. - [Delete routing rule](https://docs.trymaitai.com/api-reference/agents/delete-routing-rule.md): Permanently delete a routing rule. - [Disable action](https://docs.trymaitai.com/api-reference/agents/disable-action.md): Disable an action so the agent no longer invokes it. - [Disable sub agent](https://docs.trymaitai.com/api-reference/agents/disable-sub-agent.md): Disable a sub-agent relationship without removing it. - [Enable action](https://docs.trymaitai.com/api-reference/agents/enable-action.md): Re-enable a previously disabled action. - [Enable sub agent](https://docs.trymaitai.com/api-reference/agents/enable-sub-agent.md): Re-enable a previously disabled sub-agent relationship. - [Get agent](https://docs.trymaitai.com/api-reference/agents/get-agent.md): Retrieve an agent by ID. Use `detailed=true` to include actions, sub-agents, and full config. - [Get agent action](https://docs.trymaitai.com/api-reference/agents/get-agent-action.md): Retrieve a single action by ID. - [Get agent session detail](https://docs.trymaitai.com/api-reference/agents/get-agent-session-detail.md): Retrieve an agent session including all its requests and responses. - [Get agent session timeline](https://docs.trymaitai.com/api-reference/agents/get-agent-session-timeline.md): Retrieve the chronological timeline of events in an agent session. - [Get agent task timeline](https://docs.trymaitai.com/api-reference/agents/get-agent-task-timeline.md): Retrieve the timeline for a specific task within an agent session. - [Get agent task tree](https://docs.trymaitai.com/api-reference/agents/get-agent-task-tree.md): Retrieve the hierarchical tree of sub-tasks spawned from a root task. - [Get agent version](https://docs.trymaitai.com/api-reference/agents/get-agent-version.md): Retrieve a specific agent version snapshot by version string. - [Get form fields](https://docs.trymaitai.com/api-reference/agents/get-form-fields.md): Retrieve the form field definitions for an agent's input form. - [Get routing config](https://docs.trymaitai.com/api-reference/agents/get-routing-config.md): Retrieve the routing configuration and all routing rules for an agent. - [List action versions](https://docs.trymaitai.com/api-reference/agents/list-action-versions.md): List published versions of an action. - [List agent actions](https://docs.trymaitai.com/api-reference/agents/list-agent-actions.md): List all actions (capabilities) configured for an agent. - [List agent releases](https://docs.trymaitai.com/api-reference/agents/list-agent-releases.md): List all named releases (e.g. production, staging) for an agent. - [List agent sessions](https://docs.trymaitai.com/api-reference/agents/list-agent-sessions.md): List paginated agent sessions, optionally filtered by version. - [List agent versions](https://docs.trymaitai.com/api-reference/agents/list-agent-versions.md): List published versions of an agent, ordered by most recent. - [List agents](https://docs.trymaitai.com/api-reference/agents/list-agents.md): List all agents belonging to your company. Optionally include sub-agents and actions. - [List sub agents](https://docs.trymaitai.com/api-reference/agents/list-sub-agents.md): List all sub-agents attached to a parent agent. - [Publish action version](https://docs.trymaitai.com/api-reference/agents/publish-action-version.md): Publish the current action configuration as a new versioned snapshot. - [Publish agent version](https://docs.trymaitai.com/api-reference/agents/publish-agent-version.md): Publish the current draft agent configuration as a new versioned snapshot. - [Remove sub agent](https://docs.trymaitai.com/api-reference/agents/remove-sub-agent.md): Detach a sub-agent from its parent. - [Update agent](https://docs.trymaitai.com/api-reference/agents/update-agent.md): Update agent fields such as name, description, config, status, or strategy instructions. - [Update agent action](https://docs.trymaitai.com/api-reference/agents/update-agent-action.md): Update an action's name, type, description, config, or invocation mode. - [Update form fields](https://docs.trymaitai.com/api-reference/agents/update-form-fields.md): Replace all form field definitions for an agent. - [Update routing config](https://docs.trymaitai.com/api-reference/agents/update-routing-config.md): Update the routing mode (llm or rules) and default route for an agent. - [Update routing rule](https://docs.trymaitai.com/api-reference/agents/update-routing-rule.md): Update the conditions, route, or label of an existing routing rule. - [Upsert agent release](https://docs.trymaitai.com/api-reference/agents/upsert-agent-release.md): Create or update a named release, optionally pinning it to a version. - [Create application](https://docs.trymaitai.com/api-reference/applications/create-application.md): Create a new application under your company. - [Delete application](https://docs.trymaitai.com/api-reference/applications/delete-application.md): Permanently delete an application and all its associated intents. - [Disable intent notifications](https://docs.trymaitai.com/api-reference/applications/disable-intent-notifications.md): Disable fault notifications for an intent. - [Enable intent notifications](https://docs.trymaitai.com/api-reference/applications/enable-intent-notifications.md): Enable fault notifications for an intent. - [Get application](https://docs.trymaitai.com/api-reference/applications/get-application.md): Retrieve a single application by ID with full detail. - [Get application config](https://docs.trymaitai.com/api-reference/applications/get-application-config.md): Retrieve the configuration object for an application. - [List application models](https://docs.trymaitai.com/api-reference/applications/list-application-models.md): List all models assigned to an application. - [List application sessions](https://docs.trymaitai.com/api-reference/applications/list-application-sessions.md): List paginated chat sessions for an application. - [List application workflow runs](https://docs.trymaitai.com/api-reference/applications/list-application-workflow-runs.md): List paginated workflow execution runs for an application. - [List applications](https://docs.trymaitai.com/api-reference/applications/list-applications.md): List all applications belonging to your company. Use `detailed=true` to include full configuration. - [Reset intent config](https://docs.trymaitai.com/api-reference/applications/reset-intent-config.md): Reset an intent's configuration to the application/default configuration. - [Update application](https://docs.trymaitai.com/api-reference/applications/update-application.md): Update an application's name, reference name, or other fields. - [Update application config](https://docs.trymaitai.com/api-reference/applications/update-application-config.md): Replace the configuration object for an application. - [Delete conversation tree](https://docs.trymaitai.com/api-reference/conversation-trees/delete-conversation-tree.md): Permanently delete a conversation tree and all its versions. - [Get conversation tree](https://docs.trymaitai.com/api-reference/conversation-trees/get-conversation-tree.md): Retrieve a conversation tree configuration and its node structure. - [Get conversation tree status](https://docs.trymaitai.com/api-reference/conversation-trees/get-conversation-tree-status.md): Check the execution status of a conversation tree data generation run. - [List conversation tree versions](https://docs.trymaitai.com/api-reference/conversation-trees/list-conversation-tree-versions.md): List all saved versions of a conversation tree. - [List conversation trees](https://docs.trymaitai.com/api-reference/conversation-trees/list-conversation-trees.md): List synthetic conversation trees. Optionally filter by `application_id`. - [Add dataset requests bulk](https://docs.trymaitai.com/api-reference/datasets/add-dataset-requests-bulk.md): Add requests to a dataset using the Portal bulk payload shape. - [Add dataset tag](https://docs.trymaitai.com/api-reference/datasets/add-dataset-tag.md): Add a tag to a dataset. - [Add requests to dataset](https://docs.trymaitai.com/api-reference/datasets/add-requests-to-dataset.md): Add request/response pairs to a dataset. Body: `{"requests": [{"request_id": "..."}]}`. - [Apply dataset prune](https://docs.trymaitai.com/api-reference/datasets/apply-dataset-prune.md): Apply dataset pruning. - [Apply dataset regex replacements](https://docs.trymaitai.com/api-reference/datasets/apply-dataset-regex-replacements.md): Apply regex replacements to dataset rows. - [Augment dataset reasoning](https://docs.trymaitai.com/api-reference/datasets/augment-dataset-reasoning.md): Augment dataset rows with reasoning. - [Cancel dataset generation](https://docs.trymaitai.com/api-reference/datasets/cancel-dataset-generation.md): Cancel AI dataset generation. - [Cancel dataset s3 import](https://docs.trymaitai.com/api-reference/datasets/cancel-dataset-s3-import.md): Cancel an in-progress S3 dataset import. - [Clone dataset](https://docs.trymaitai.com/api-reference/datasets/clone-dataset.md): Clone a dataset. - [Create dataset](https://docs.trymaitai.com/api-reference/datasets/create-dataset.md): Create a new training dataset linked to an intent group. - [Delete dataset](https://docs.trymaitai.com/api-reference/datasets/delete-dataset.md): Permanently delete a dataset and disassociate its requests. - [Estimate dataset generation cost](https://docs.trymaitai.com/api-reference/datasets/estimate-dataset-generation-cost.md): Estimate AI dataset generation cost. - [Get dataset](https://docs.trymaitai.com/api-reference/datasets/get-dataset.md): Retrieve a single dataset by ID. - [Get dataset prompt](https://docs.trymaitai.com/api-reference/datasets/get-dataset-prompt.md): Get a generated prompt summary for a dataset. - [Get dataset regex replacements applicable count](https://docs.trymaitai.com/api-reference/datasets/get-dataset-regex-replacements-applicable-count.md): Count dataset rows that would be affected by regex replacements. - [Get dataset request distribution](https://docs.trymaitai.com/api-reference/datasets/get-dataset-request-distribution.md): Get request distribution facets for a dataset. - [Get dataset request reasoning](https://docs.trymaitai.com/api-reference/datasets/get-dataset-request-reasoning.md): Get reasoning for one dataset request. - [Get dataset s3 syncer info](https://docs.trymaitai.com/api-reference/datasets/get-dataset-s3-syncer-info.md): Get S3 syncer service account and external ID details. - [Get dataset status](https://docs.trymaitai.com/api-reference/datasets/get-dataset-status.md): Get dataset import/generation status. - [Get estimated dataset request count](https://docs.trymaitai.com/api-reference/datasets/get-estimated-dataset-request-count.md): Estimate dataset request count for the provided filters. - [List dataset request ids](https://docs.trymaitai.com/api-reference/datasets/list-dataset-request-ids.md): List request IDs included in a dataset. - [List dataset requests](https://docs.trymaitai.com/api-reference/datasets/list-dataset-requests.md): List the request/response pairs included in a dataset. - [List dataset tags](https://docs.trymaitai.com/api-reference/datasets/list-dataset-tags.md): List tags for a dataset. - [List dataset versions](https://docs.trymaitai.com/api-reference/datasets/list-dataset-versions.md): List dataset versions. - [List datasets](https://docs.trymaitai.com/api-reference/datasets/list-datasets.md): List all training datasets for your company. - [List datasets by intent](https://docs.trymaitai.com/api-reference/datasets/list-datasets-by-intent.md): List datasets for an application intent. - [List datasets by intent group](https://docs.trymaitai.com/api-reference/datasets/list-datasets-by-intent-group.md): List datasets for an intent group. - [List datasets by tags](https://docs.trymaitai.com/api-reference/datasets/list-datasets-by-tags.md): List datasets matching tag filters. - [List datasets by test set](https://docs.trymaitai.com/api-reference/datasets/list-datasets-by-test-set.md): List datasets that are associated with a test set. - [List eligible dataset requests](https://docs.trymaitai.com/api-reference/datasets/list-eligible-dataset-requests.md): List requests eligible for addition to a dataset. - [List valid dataset tags](https://docs.trymaitai.com/api-reference/datasets/list-valid-dataset-tags.md): List valid dataset tags. - [Pause dataset generation](https://docs.trymaitai.com/api-reference/datasets/pause-dataset-generation.md): Pause AI dataset generation. - [Preview dataset generation](https://docs.trymaitai.com/api-reference/datasets/preview-dataset-generation.md): Preview AI-generated dataset rows. - [Preview dataset prune](https://docs.trymaitai.com/api-reference/datasets/preview-dataset-prune.md): Preview dataset pruning. - [Reimport dataset s3 source](https://docs.trymaitai.com/api-reference/datasets/reimport-dataset-s3-source.md): Re-run S3 import for a dataset. - [Remove dataset requests bulk](https://docs.trymaitai.com/api-reference/datasets/remove-dataset-requests-bulk.md): Remove requests from a dataset using the Portal bulk payload shape. - [Remove dataset tag](https://docs.trymaitai.com/api-reference/datasets/remove-dataset-tag.md): Remove a tag from a dataset. - [Remove requests from dataset](https://docs.trymaitai.com/api-reference/datasets/remove-requests-from-dataset.md): Remove request/response pairs from a dataset. Body: `{"requests": [{"request_id": "..."}]}`. - [Resume dataset generation](https://docs.trymaitai.com/api-reference/datasets/resume-dataset-generation.md): Resume AI dataset generation. - [Sample clone dataset](https://docs.trymaitai.com/api-reference/datasets/sample-clone-dataset.md): Create a sampled clone of a dataset. - [Search added dataset requests](https://docs.trymaitai.com/api-reference/datasets/search-added-dataset-requests.md): Search requests already added to a dataset. - [Search eligible dataset requests](https://docs.trymaitai.com/api-reference/datasets/search-eligible-dataset-requests.md): Search requests eligible for addition to a dataset. - [Set dataset tags](https://docs.trymaitai.com/api-reference/datasets/set-dataset-tags.md): Replace all tags on a dataset. - [Start dataset generation](https://docs.trymaitai.com/api-reference/datasets/start-dataset-generation.md): Start AI dataset generation. - [Update dataset](https://docs.trymaitai.com/api-reference/datasets/update-dataset.md): Update a dataset's name, description, or sampling configuration. - [Validate dataset s3 source](https://docs.trymaitai.com/api-reference/datasets/validate-dataset-s3-source.md): Validate an S3 source before dataset import. - [Create evaluation](https://docs.trymaitai.com/api-reference/evaluations/create-evaluation.md): Start a batch evaluation run against selected sentinels and requests. - [Get evaluation](https://docs.trymaitai.com/api-reference/evaluations/get-evaluation.md): Retrieve an evaluation run. Use `full=true` to include all request data. - [Get evaluation results](https://docs.trymaitai.com/api-reference/evaluations/get-evaluation-results.md): Retrieve per-request evaluation scores and sentinel verdicts for a run. - [List evaluations](https://docs.trymaitai.com/api-reference/evaluations/list-evaluations.md): List all evaluation runs for your company. - [Cancel finetune run](https://docs.trymaitai.com/api-reference/finetune-runs/cancel-finetune-run.md): Cancel a running finetune job. - [Create finetune run](https://docs.trymaitai.com/api-reference/finetune-runs/create-finetune-run.md): Start a new model finetuning job using a training dataset. - [Get finetune run](https://docs.trymaitai.com/api-reference/finetune-runs/get-finetune-run.md): Retrieve a finetune run with its configuration and current status. - [Get finetune run metrics](https://docs.trymaitai.com/api-reference/finetune-runs/get-finetune-run-metrics.md): Retrieve training loss and accuracy metrics for a finetune run. - [List finetune runs](https://docs.trymaitai.com/api-reference/finetune-runs/list-finetune-runs.md): List all finetune runs for your company. Optionally filter by `status`. - [Get intent group](https://docs.trymaitai.com/api-reference/intent-groups/get-intent-group.md): Retrieve a single intent group by ID. Use `detailed=true` (default) for full details. - [Get intent group config](https://docs.trymaitai.com/api-reference/intent-groups/get-intent-group-config.md): Retrieve the configuration for an intent group. - [List intent group compositions](https://docs.trymaitai.com/api-reference/intent-groups/list-intent-group-compositions.md): List all dataset compositions for an intent group. - [List intent group datasets](https://docs.trymaitai.com/api-reference/intent-groups/list-intent-group-datasets.md): List all training datasets for an intent group. - [List intent group models](https://docs.trymaitai.com/api-reference/intent-groups/list-intent-group-models.md): List all models assigned to an intent group. - [List intent group requests](https://docs.trymaitai.com/api-reference/intent-groups/list-intent-group-requests.md): List paginated requests for an intent group with optional date range and message filtering. - [List intent group sentinels](https://docs.trymaitai.com/api-reference/intent-groups/list-intent-group-sentinels.md): List all sentinels attached to an intent group. - [List intent group test sets](https://docs.trymaitai.com/api-reference/intent-groups/list-intent-group-test-sets.md): List all test sets associated with an intent group. - [List intent groups](https://docs.trymaitai.com/api-reference/intent-groups/list-intent-groups.md): List all intent groups for your company with pagination. - [List intents by group](https://docs.trymaitai.com/api-reference/intent-groups/list-intents-by-group.md): List all intents belonging to an intent group across applications. - [Update intent group config](https://docs.trymaitai.com/api-reference/intent-groups/update-intent-group-config.md): Replace the configuration for an intent group. - [Create application intent](https://docs.trymaitai.com/api-reference/intents/create-application-intent.md): Create a new intent (application action) for an application. - [Delete application intent](https://docs.trymaitai.com/api-reference/intents/delete-application-intent.md): Delete an intent (application action) from an application. - [Get application intent](https://docs.trymaitai.com/api-reference/intents/get-application-intent.md): Retrieve a single intent by ID within an application. - [Get intent config](https://docs.trymaitai.com/api-reference/intents/get-intent-config.md): Retrieve the configuration for a specific intent. - [List application intents](https://docs.trymaitai.com/api-reference/intents/list-application-intents.md): List all intents (application actions) for an application with details. - [Update intent config](https://docs.trymaitai.com/api-reference/intents/update-intent-config.md): Replace the configuration for a specific intent. - [Attach model inference pool](https://docs.trymaitai.com/api-reference/models/attach-model-inference-pool.md): Attach an inference pool to a model. - [Create base model](https://docs.trymaitai.com/api-reference/models/create-base-model.md): Create a Maitai base model registry entry. - [Detach model inference pool](https://docs.trymaitai.com/api-reference/models/detach-model-inference-pool.md): Detach an inference pool from a model. - [Disable model](https://docs.trymaitai.com/api-reference/models/disable-model.md): Disable a model so it is no longer used for inference. - [Enable model](https://docs.trymaitai.com/api-reference/models/enable-model.md): Re-enable a previously disabled model for inference. - [Execute swap model ref](https://docs.trymaitai.com/api-reference/models/execute-swap-model-ref.md): Execute a model ref replacement. - [Get model](https://docs.trymaitai.com/api-reference/models/get-model.md): Get model details. - [Get model inference pool](https://docs.trymaitai.com/api-reference/models/get-model-inference-pool.md): Get the inference pool attached to a model. - [Get model inference pool debug](https://docs.trymaitai.com/api-reference/models/get-model-inference-pool-debug.md): Get debug details for a model's inference pool. - [Get model repoint options](https://docs.trymaitai.com/api-reference/models/get-model-repoint-options.md): Get repointing options for a model. - [List available models](https://docs.trymaitai.com/api-reference/models/list-available-models.md): List all models available to your company, including base and finetuned models. - [List model inference pool attach candidates](https://docs.trymaitai.com/api-reference/models/list-model-inference-pool-attach-candidates.md): List inference pools that can be attached to a model. - [List models](https://docs.trymaitai.com/api-reference/models/list-models.md): List enabled models for your company. Optionally filter by `model_type`. - [List models by application](https://docs.trymaitai.com/api-reference/models/list-models-by-application.md): List models for an application. - [List models by intent](https://docs.trymaitai.com/api-reference/models/list-models-by-intent.md): List models for an intent. - [List models by intent group](https://docs.trymaitai.com/api-reference/models/list-models-by-intent-group.md): List models for an intent group. - [Patch model registry](https://docs.trymaitai.com/api-reference/models/patch-model-registry.md): Patch model registry metadata. - [Preview swap model ref](https://docs.trymaitai.com/api-reference/models/preview-swap-model-ref.md): Preview replacing a model ref. - [Repoint model](https://docs.trymaitai.com/api-reference/models/repoint-model.md): Repoint a model. - [API Reference](https://docs.trymaitai.com/api-reference/overview.md): Programmatically manage Maitai resources using the REST API. - [Get request](https://docs.trymaitai.com/api-reference/requests/get-request.md): Retrieve a single request and its corresponding response. - [List requests](https://docs.trymaitai.com/api-reference/requests/list-requests.md): List requests filtered by application_id + intent_id, with date range. - [Update request response](https://docs.trymaitai.com/api-reference/requests/update-request-response.md): Update/correct a response for a request. Send `message_content` (string) in the body. - [Create sentinel](https://docs.trymaitai.com/api-reference/sentinels/create-sentinel.md): Create a new sentinel to monitor model output quality for an intent group. - [Delete sentinel](https://docs.trymaitai.com/api-reference/sentinels/delete-sentinel.md): Permanently delete a sentinel. - [Generate new sentinel](https://docs.trymaitai.com/api-reference/sentinels/generate-new-sentinel.md): Generate a new sentinel. - [Generate sentinels](https://docs.trymaitai.com/api-reference/sentinels/generate-sentinels.md): Generate sentinels. - [Get sentinel](https://docs.trymaitai.com/api-reference/sentinels/get-sentinel.md): Retrieve a single sentinel by ID. - [List sentinels](https://docs.trymaitai.com/api-reference/sentinels/list-sentinels.md): List all sentinels (evaluation watchers) for your company. - [List sentinels by application](https://docs.trymaitai.com/api-reference/sentinels/list-sentinels-by-application.md): List sentinels for an application. - [List sentinels by application human needs](https://docs.trymaitai.com/api-reference/sentinels/list-sentinels-by-application-human-needs.md): List human-needs sentinels for an application. - [List sentinels by intent group](https://docs.trymaitai.com/api-reference/sentinels/list-sentinels-by-intent-group.md): List sentinels for an intent group. - [List sentinels by intent name](https://docs.trymaitai.com/api-reference/sentinels/list-sentinels-by-intent-name.md): List sentinels for an intent group name. - [List simple sentinels](https://docs.trymaitai.com/api-reference/sentinels/list-simple-sentinels.md): List lightweight sentinel rows. - [Regenerate sentinel](https://docs.trymaitai.com/api-reference/sentinels/regenerate-sentinel.md): Regenerate a sentinel. - [Regenerate sentinel correction](https://docs.trymaitai.com/api-reference/sentinels/regenerate-sentinel-correction.md): Regenerate a sentinel correction prompt. - [Regenerate sentinel evaluation](https://docs.trymaitai.com/api-reference/sentinels/regenerate-sentinel-evaluation.md): Regenerate a sentinel evaluation prompt. - [Regenerate sentinel qualification](https://docs.trymaitai.com/api-reference/sentinels/regenerate-sentinel-qualification.md): Regenerate a sentinel qualification prompt. - [Regenerate sentinels](https://docs.trymaitai.com/api-reference/sentinels/regenerate-sentinels.md): Regenerate multiple sentinels. - [Update sentinel](https://docs.trymaitai.com/api-reference/sentinels/update-sentinel.md): Update a sentinel's name, severity, directives, or configuration. - [Update sentinel directive](https://docs.trymaitai.com/api-reference/sentinels/update-sentinel-directive.md): Update a sentinel directive. - [Get session](https://docs.trymaitai.com/api-reference/sessions/get-session.md): Retrieve a single session by ID. Requires `application_id` query param. - [Get session timeline](https://docs.trymaitai.com/api-reference/sessions/get-session-timeline.md): Retrieve the chronological request timeline for a session. Requires `application_id` query param. - [List sessions](https://docs.trymaitai.com/api-reference/sessions/list-sessions.md): List classic (non-agent) chat sessions. Optionally filter by `application_id`. - [Set session feedback](https://docs.trymaitai.com/api-reference/sessions/set-session-feedback.md): Submit feedback (rating, notes) for a session. - [Compare test runs](https://docs.trymaitai.com/api-reference/test-runs/compare-test-runs.md): Compare completed test runs by test-set request. - [Create test run](https://docs.trymaitai.com/api-reference/test-runs/create-test-run.md): Create and start a new test run against a test set. - [Delete test run](https://docs.trymaitai.com/api-reference/test-runs/delete-test-run.md): Permanently delete a test run and its results. - [Evaluate test run](https://docs.trymaitai.com/api-reference/test-runs/evaluate-test-run.md): Re-evaluate all requests for a test run. - [Evaluate test run request](https://docs.trymaitai.com/api-reference/test-runs/evaluate-test-run-request.md): Re-evaluate a single request in a test run. - [Get test run](https://docs.trymaitai.com/api-reference/test-runs/get-test-run.md): Retrieve a single test run with its configuration and summary results. - [Get test run progress](https://docs.trymaitai.com/api-reference/test-runs/get-test-run-progress.md): Check how many requests have completed in a running test run. - [Get test run progress by test set](https://docs.trymaitai.com/api-reference/test-runs/get-test-run-progress-by-test-set.md): Get progress for active test runs on a test set. - [Get test run request comparison](https://docs.trymaitai.com/api-reference/test-runs/get-test-run-request-comparison.md): Compare two test-run request results. - [Get test run results](https://docs.trymaitai.com/api-reference/test-runs/get-test-run-results.md): Get aggregate test-run results. - [List test run requests](https://docs.trymaitai.com/api-reference/test-runs/list-test-run-requests.md): List individual request results from a test run with scores and responses. - [List test run requests with filters](https://docs.trymaitai.com/api-reference/test-runs/list-test-run-requests-with-filters.md): List individual test-run request results with Portal filters. - [List test runs](https://docs.trymaitai.com/api-reference/test-runs/list-test-runs.md): List test runs for your company. Requires `intent_group_id` query param. - [List test runs by intent group](https://docs.trymaitai.com/api-reference/test-runs/list-test-runs-by-intent-group.md): List test runs for an intent group. - [List test runs by test set](https://docs.trymaitai.com/api-reference/test-runs/list-test-runs-by-test-set.md): List test runs for a test set. - [Retry test run](https://docs.trymaitai.com/api-reference/test-runs/retry-test-run.md): Retry a test run. - [Stop test run](https://docs.trymaitai.com/api-reference/test-runs/stop-test-run.md): Stop a running test run. - [Update test run status](https://docs.trymaitai.com/api-reference/test-runs/update-test-run-status.md): Update test-run status. - [Add requests to test set](https://docs.trymaitai.com/api-reference/test-sets/add-requests-to-test-set.md): Add request/response pairs to a test set. Body: `{"requests": [{"request_id": "..."}]}`. - [Add single request to test set](https://docs.trymaitai.com/api-reference/test-sets/add-single-request-to-test-set.md): Add one request to a test set using the Portal payload shape. - [Add test set requests bulk](https://docs.trymaitai.com/api-reference/test-sets/add-test-set-requests-bulk.md): Add requests to a test set using the Portal bulk payload shape. - [Convert test set to workflow](https://docs.trymaitai.com/api-reference/test-sets/convert-test-set-to-workflow.md): Convert a regular test set into a workflow test set. - [Create test set](https://docs.trymaitai.com/api-reference/test-sets/create-test-set.md): Create a new test set for evaluating model performance. - [Delete test set](https://docs.trymaitai.com/api-reference/test-sets/delete-test-set.md): Permanently delete a test set. - [Get test set](https://docs.trymaitai.com/api-reference/test-sets/get-test-set.md): Retrieve a single test set by ID. - [Get test set request distribution](https://docs.trymaitai.com/api-reference/test-sets/get-test-set-request-distribution.md): Get request distribution facets for a test set. - [List eligible test set requests](https://docs.trymaitai.com/api-reference/test-sets/list-eligible-test-set-requests.md): List requests eligible for addition to a test set. - [List test set requests](https://docs.trymaitai.com/api-reference/test-sets/list-test-set-requests.md): List the request/response pairs included in a test set. - [List test set session facets](https://docs.trymaitai.com/api-reference/test-sets/list-test-set-session-facets.md): List session facets for requests in a test set. - [List test sets](https://docs.trymaitai.com/api-reference/test-sets/list-test-sets.md): List all test sets for your company with pagination. - [List test sets by application intent](https://docs.trymaitai.com/api-reference/test-sets/list-test-sets-by-application-intent.md): List test sets for an application intent. - [List test sets by dataset](https://docs.trymaitai.com/api-reference/test-sets/list-test-sets-by-dataset.md): List test sets associated with a dataset. - [List test sets by intent group](https://docs.trymaitai.com/api-reference/test-sets/list-test-sets-by-intent-group.md): List test sets for an intent group. - [List test sets by intent group name](https://docs.trymaitai.com/api-reference/test-sets/list-test-sets-by-intent-group-name.md): List test sets by intent group name. - [List test sets created from dataset](https://docs.trymaitai.com/api-reference/test-sets/list-test-sets-created-from-dataset.md): List test sets created from a dataset. - [Remove requests from test set](https://docs.trymaitai.com/api-reference/test-sets/remove-requests-from-test-set.md): Remove request/response pairs from a test set. Body: `{"requests": [{"request_id": "..."}]}`. - [Remove single request from test set](https://docs.trymaitai.com/api-reference/test-sets/remove-single-request-from-test-set.md): Remove one request from a test set using the Portal payload shape. - [Remove test set requests bulk](https://docs.trymaitai.com/api-reference/test-sets/remove-test-set-requests-bulk.md): Remove requests from a test set using the Portal bulk payload shape. - [Sample clone test set](https://docs.trymaitai.com/api-reference/test-sets/sample-clone-test-set.md): Create a sampled clone of a test set. - [Search eligible test set requests](https://docs.trymaitai.com/api-reference/test-sets/search-eligible-test-set-requests.md): Search requests eligible for addition to a test set. - [Update test set](https://docs.trymaitai.com/api-reference/test-sets/update-test-set.md): Update a test set's name, description, or metadata. - [Update test set request response](https://docs.trymaitai.com/api-reference/test-sets/update-test-set-request-response.md): Update the expected response on one test-set request. - [Update test set request tags](https://docs.trymaitai.com/api-reference/test-sets/update-test-set-request-tags.md): Update tags on one test-set request. - [Agent Form](https://docs.trymaitai.com/build/agents/agent_form.md): Maintaining structured state and memory within a session - [API Action](https://docs.trymaitai.com/build/agents/capabilities/api_action.md): Integrating external services into your agent workflows - [LLM Action](https://docs.trymaitai.com/build/agents/capabilities/llm_action.md): Specialized sub-tasks with unique prompts and model configs - [Subagent](https://docs.trymaitai.com/build/agents/capabilities/subagent.md): Recursive hierarchical delegation to specialized agents - [Webhook](https://docs.trymaitai.com/build/agents/capabilities/webhook.md): Handling asynchronous callbacks and long-running tasks - [Create Agent](https://docs.trymaitai.com/build/agents/create_agent.md): Defining the identity and context of your AI Agent - [Orchestration](https://docs.trymaitai.com/build/agents/orchestration.md): Defining how your agent routes and delegates tasks - [Special Instructions](https://docs.trymaitai.com/build/agents/special_instructions.md): Guidance for strategizing and processing results - [Compositions](https://docs.trymaitai.com/build/models/compositions.md): Creating dataset recipes for optimal fine-tuning - [Dataset Creation](https://docs.trymaitai.com/build/models/dataset_creation.md): How to capture and generate data for fine-tuning - [Dataset Preparation](https://docs.trymaitai.com/build/models/dataset_preparation.md): Reviewing, fixing, and augmenting your training data - [Deployment](https://docs.trymaitai.com/build/models/deployment.md): Promoting fine-tuned models to production endpoints - [Fine-tune Runs](https://docs.trymaitai.com/build/models/fine_tune_runs.md): Executing and monitoring managed training - [Reasoning Augmentation](https://docs.trymaitai.com/build/models/reasoning_augmentation.md): Teach your model to think step-by-step with structured chain-of-thought augmentation - [Validation](https://docs.trymaitai.com/build/models/validation.md): Reviewing automated results and checking for regressions - [Data Generation](https://docs.trymaitai.com/build/scts/data_generation.md): Creating robust synthetic datasets for training and testing - [Visualizer](https://docs.trymaitai.com/build/scts/visualizer.md): Mapping out potential conversation paths and logic - [Commands](https://docs.trymaitai.com/cli-reference/commands.md): Full CLI command reference for resource commands and raw API. - [CLI Reference](https://docs.trymaitai.com/cli-reference/overview.md): Command-line interface for the Maitai Platform Developer API. - [API → Agent](https://docs.trymaitai.com/examples/api_to_agent.md): Turn an API into a structured Agent by importing endpoints as API Call actions, organizing them into domain subagents, and encoding the API docs as instructions. - [Build an Agent](https://docs.trymaitai.com/examples/build_agent.md): Create a new Agent, add capabilities, and configure orchestration - [Configuration](https://docs.trymaitai.com/examples/configuration.md): Common Portal configuration patterns (application / intent / intent group) - [Debug a Request with Reruns + Evaluations](https://docs.trymaitai.com/examples/debug_request_reruns.md): Test variations of a single request (model/messages) and evaluate them with Sentinels - [Fine-tune a Model](https://docs.trymaitai.com/examples/fine_tuning.md): End-to-end workflow: Dataset → Composition → Run → Validation - [Import Data](https://docs.trymaitai.com/examples/import_data.md): Upload your data to the Portal to build custom models specific to your application - [Quality Loop (Fault → Fix → Regression Test)](https://docs.trymaitai.com/examples/quality_loop.md): A repeatable Portal workflow to fix failures and prevent them from coming back - [Sentinel Workflow](https://docs.trymaitai.com/examples/sentinel_workflow.md): How to create a Sentinel for an Intent Group and validate it against real traffic - [Execute Test Runs](https://docs.trymaitai.com/examples/test_runs.md): Monitor model performance improvements with Test Runs - [Create Test Sets](https://docs.trymaitai.com/examples/test_sets.md): Turn real requests into a regression suite you can rerun as you iterate - [Authentication](https://docs.trymaitai.com/get_started/authentication.md): Authenticate using a Maitai API key (and optionally provider keys). - [Base URL](https://docs.trymaitai.com/get_started/base_url.md): Integrate Maitai with your existing OpenAI SDK implementation by changing the base URL and adding a few headers. - [Core Concepts](https://docs.trymaitai.com/get_started/core_concepts.md): The mental model: Company → Application → Intent, plus Sessions, Intent Groups, and quality tooling. - [Introduction](https://docs.trymaitai.com/get_started/introduction.md): What Maitai is, and the fastest way to get value - [Quickstart](https://docs.trymaitai.com/get_started/quickstart.md): Send your first request through Maitai and view it in the Portal. - [Sessions](https://docs.trymaitai.com/observe/agent_sessions.md): Debug multi-turn behavior (including agent runs) via session timelines and task details. - [Request Overview](https://docs.trymaitai.com/observe/request_overview.md): Inspect a single request, create reruns, and compare prompt/model changes. - [Applications](https://docs.trymaitai.com/observe/resources/applications.md): How Applications are represented in the Portal (lists, detail pages, and tabs) - [Intent Groups](https://docs.trymaitai.com/observe/resources/intent_groups.md): How Intent Groups work in the Portal (cross-application organization) - [Intents](https://docs.trymaitai.com/observe/resources/intents.md): How Intents (ApplicationActions) work in the Portal - [Agent Call](https://docs.trymaitai.com/sdk/agent_call.md): Send a request to an Agent you built in the Portal. - [Model Request](https://docs.trymaitai.com/sdk/chat.md): Create chat completions with Maitai metadata (Application, Intent, Session). - [Evaluate](https://docs.trymaitai.com/sdk/evaluate.md): Detect faults in LLM output - [Indexing-only (Bring Your Own Inference)](https://docs.trymaitai.com/sdk/indexing.md): Send requests + responses to Maitai for indexing/storage without routing inference through Maitai. - [Reasoning](https://docs.trymaitai.com/sdk/reasoning.md): Use chain-of-thought and extended thinking with a single, provider-agnostic API. - [Structured Output](https://docs.trymaitai.com/sdk/structured_output.md): Generate consistent JSON using JSON Schema (or Pydantic models in Python). - [Tool Calling](https://docs.trymaitai.com/sdk/tool_calling.md): Define tools and let the model call them (OpenAI-style tool calling). - [Speech to text](https://docs.trymaitai.com/sdk/transcription.md): Convert audio files to text using Maitai's speech-to-text API. - [Evaluations](https://docs.trymaitai.com/test/evaluations/overview.md): How Maitai evaluates requests using Sentinels (one-off, batch runs, and global results) - [Evaluating a Request](https://docs.trymaitai.com/test/evaluations/request_evaluations.md): Run one-off evaluations on a single request (and compare versions) - [Evaluation Results](https://docs.trymaitai.com/test/evaluations/results.md): Filter and drill down into evaluation outcomes across your traffic - [Evaluation Runs](https://docs.trymaitai.com/test/evaluations/runs.md): Run sentinels across a time range of real requests for an app + intent - [Sentinel Configuration](https://docs.trymaitai.com/test/sentinels/configuration.md): Edit directives, examples, severity, and include options - [Generating Sentinels](https://docs.trymaitai.com/test/sentinels/generation.md): Create a new Sentinel from an Intent Group using expectation + condition - [Monitoring with Sentinels](https://docs.trymaitai.com/test/sentinels/monitoring.md): Find faults, drill into requests, and track fault rate over time - [Sentinels](https://docs.trymaitai.com/test/sentinels/overview.md): Intent-group-level watchers that evaluate model outputs - [Regenerating Sentinels](https://docs.trymaitai.com/test/sentinels/regeneration.md): Iterate quickly: regenerate qualification/evaluation/correction logic with feedback - [Test Set Creation](https://docs.trymaitai.com/test/test_sets/creation.md): How to create and manage Test Sets from real requests in the Portal - [Test Run Execution](https://docs.trymaitai.com/test/test_sets/execution.md): Create and run Test Runs for a Test Set in the Portal - [Regression Monitoring](https://docs.trymaitai.com/test/test_sets/regression.md): Use Test Runs and comparisons to detect regressions over time - [Interpreting Results](https://docs.trymaitai.com/test/test_sets/results.md): Understand Test Run scores, distributions, and comparisons in the Portal - [Scoring & Rubrics](https://docs.trymaitai.com/test/test_sets/rubrics.md): How Maitai scores Test Runs and how to interpret criteria breakdowns ## OpenAPI Specs - [openapi](https://docs.trymaitai.com/openapi.yaml)