> ## Documentation Index > Fetch the complete documentation index at: https://docs.trymaitai.com/llms.txt > Use this file to discover all available pages before exploring further. # Commands > Full CLI command reference for resource commands and raw API. ## Auth commands | Command | Description | | ----------------------------------------------- | --------------------------------------------------- | | `maitai login [--api-key KEY] [--base-url URL]` | Authenticate and store API key in \~/.maitai/config | | `maitai logout` | Remove stored credentials | | `maitai whoami` | Show current authentication status | | `maitai docs` | Show API documentation references | ## Raw API Call any endpoint directly: ```bash theme={null} maitai api METHOD path [-b JSON_BODY] ``` Examples: ```bash theme={null} maitai api GET /applications maitai api GET /applications/42 maitai api POST /applications -b '{"application_name":"Test","application_ref_name":"test"}' maitai api PUT /applications/42 -b '{"application_name":"Updated"}' maitai api DELETE /applications/42 ``` ## Resource commands Each resource is a command group. Run `maitai --help` to see available subcommands, then `maitai --help` for scoped arguments. ### `maitai agents` | CLI command | Method | Path | Operation | | ----------------------------------------- | ------ | --------------------------------------------------------- | --------------------------- | | `maitai agents list` | GET | `/agents` | listAgents | | `maitai agents get` | GET | `/agents/{agent_id}` | getAgent | | `maitai agents create` | POST | `/agents` | createAgent | | `maitai agents update` | PUT | `/agents/{agent_id}` | updateAgent | | `maitai agents delete` | DELETE | `/agents/{agent_id}` | deleteAgent | | `maitai agents disable-action` | PUT | `/agents/actions/{action_id}/disable` | disableAction | | `maitai agents enable-action` | PUT | `/agents/actions/{action_id}/enable` | enableAction | | `maitai agents publish-action-version` | POST | `/agents/actions/{action_id}/publish` | publishActionVersion | | `maitai agents restore-action-version` | POST | `/agents/actions/{action_id}/versions/{version}/restore` | restoreActionVersion | | `maitai agents list-action-versions` | GET | `/agents/actions/{action_id}/versions` | listActionVersions | | `maitai agents delete-action` | DELETE | `/agents/actions/{action_id}` | deleteAgentAction | | `maitai agents get-action` | GET | `/agents/actions/{action_id}` | getAgentAction | | `maitai agents patch-action` | PATCH | `/agents/actions/{action_id}` | patchAgentAction | | `maitai agents update-action` | PUT | `/agents/actions/{action_id}` | updateAgentAction | | `maitai agents import` | POST | `/agents/import` | importAgents | | `maitai agents list-supplied-actions` | GET | `/agents/supplied-actions` | listSuppliedActions | | `maitai agents get-task-tree` | GET | `/agents/tasks/{task_id}/tree` | getAgentTaskTree | | `maitai agents add-supplied-action` | POST | `/agents/{agent_id}/actions/supplied/{catalog_action_id}` | addSuppliedAction | | `maitai agents list-actions` | GET | `/agents/{agent_id}/actions` | listAgentActions | | `maitai agents create-action` | POST | `/agents/{agent_id}/actions` | createAgentAction | | `maitai agents delete-form-fields` | DELETE | `/agents/{agent_id}/form-fields` | deleteFormFields | | `maitai agents get-form-fields` | GET | `/agents/{agent_id}/form-fields` | getFormFields | | `maitai agents update-form-fields` | PUT | `/agents/{agent_id}/form-fields` | updateFormFields | | `maitai agents get-invocation` | GET | `/agents/{agent_id}/invocations/{task_id}` | getAgentInvocation | | `maitai agents invoke` | POST | `/agents/{agent_id}/invoke` | invokeAgent | | `maitai agents publish-version` | POST | `/agents/{agent_id}/publish` | publishAgentVersion | | `maitai agents delete-release` | DELETE | `/agents/{agent_id}/releases/{name}` | deleteAgentRelease | | `maitai agents upsert-release` | PUT | `/agents/{agent_id}/releases/{name}` | upsertAgentRelease | | `maitai agents list-releases` | GET | `/agents/{agent_id}/releases` | listAgentReleases | | `maitai agents get-routing-config` | GET | `/agents/{agent_id}/routing/config` | getRoutingConfig | | `maitai agents update-routing-config` | PUT | `/agents/{agent_id}/routing/config` | updateRoutingConfig | | `maitai agents get-routing-result` | GET | `/agents/{agent_id}/routing/results/{routing_result_id}` | getRoutingResult | | `maitai agents reorder-routing-rule` | PUT | `/agents/{agent_id}/routing/rules/{rule_id}/reorder` | reorderRoutingRule | | `maitai agents test-routing-rule` | POST | `/agents/{agent_id}/routing/rules/{rule_id}/test` | testRoutingRule | | `maitai agents delete-routing-rule` | DELETE | `/agents/{agent_id}/routing/rules/{rule_id}` | deleteRoutingRule | | `maitai agents update-routing-rule` | PUT | `/agents/{agent_id}/routing/rules/{rule_id}` | updateRoutingRule | | `maitai agents create-routing-rule` | POST | `/agents/{agent_id}/routing/rules` | createRoutingRule | | `maitai agents get-session-timeline` | GET | `/agents/{agent_id}/sessions/{session_id}/timeline` | getAgentSessionTimeline | | `maitai agents get-session-detail` | GET | `/agents/{agent_id}/sessions/{session_id}` | getAgentSessionDetail | | `maitai agents list-sessions` | GET | `/agents/{agent_id}/sessions` | listAgentSessions | | `maitai agents get-status` | GET | `/agents/{agent_id}/status` | getAgentStatus | | `maitai agents disable-sub` | PUT | `/agents/{agent_id}/subagents/{child_agent_id}/disable` | disableSubAgent | | `maitai agents enable-sub` | PUT | `/agents/{agent_id}/subagents/{child_agent_id}/enable` | enableSubAgent | | `maitai agents remove-sub` | DELETE | `/agents/{agent_id}/subagents/{child_agent_id}` | removeSubAgent | | `maitai agents list-sub` | GET | `/agents/{agent_id}/subagents` | listSubAgents | | `maitai agents add-sub` | POST | `/agents/{agent_id}/subagents` | addSubAgent | | `maitai agents reset-system-step-config` | DELETE | `/agents/{agent_id}/system-steps/{step}/config` | resetAgentSystemStepConfig | | `maitai agents get-system-step-config` | GET | `/agents/{agent_id}/system-steps/{step}/config` | getAgentSystemStepConfig | | `maitai agents update-system-step-config` | PUT | `/agents/{agent_id}/system-steps/{step}/config` | updateAgentSystemStepConfig | | `maitai agents disable-system-step` | PUT | `/agents/{agent_id}/system-steps/{step}/disable` | disableAgentSystemStep | | `maitai agents enable-system-step` | PUT | `/agents/{agent_id}/system-steps/{step}/enable` | enableAgentSystemStep | | `maitai agents reset-system-step-prompt` | DELETE | `/agents/{agent_id}/system-steps/{step}/prompt` | resetAgentSystemStepPrompt | | `maitai agents get-system-step-prompt` | GET | `/agents/{agent_id}/system-steps/{step}/prompt` | getAgentSystemStepPrompt | | `maitai agents update-system-step-prompt` | PUT | `/agents/{agent_id}/system-steps/{step}/prompt` | updateAgentSystemStepPrompt | | `maitai agents list-system-steps` | GET | `/agents/{agent_id}/system-steps` | listAgentSystemSteps | | `maitai agents get-task-timeline` | GET | `/agents/{agent_id}/tasks/{task_id}/timeline` | getAgentTaskTimeline | | `maitai agents diff-versions` | GET | `/agents/{agent_id}/versions/diff` | diffAgentVersions | | `maitai agents restore-version` | POST | `/agents/{agent_id}/versions/{version}/restore` | restoreAgentVersion | | `maitai agents get-version` | GET | `/agents/{agent_id}/versions/{version}` | getAgentVersion | | `maitai agents list-versions` | GET | `/agents/{agent_id}/versions` | listAgentVersions | | `maitai agents patch` | PATCH | `/agents/{agent_id}` | patchAgent | ### `maitai analytics` | CLI command | Method | Path | Operation | | ---------------------------------------------------- | ------ | ------------------------------------------------------------------------- | -------------------------------------- | | `maitai analytics get-agent-request` | GET | `/analytics/agents/{agent_id}/requests` | getAgentRequestAnalytics | | `maitai analytics get-application-fault-rate` | GET | `/analytics/applications/{application_id}/fault-rate` | getApplicationFaultRateAnalytics | | `maitai analytics get-application-action-fault-rate` | GET | `/analytics/applications/{application_id}/intents/{action_id}/fault-rate` | getApplicationActionFaultRateAnalytics | | `maitai analytics get-application-action-request` | GET | `/analytics/applications/{application_id}/intents/{action_id}/requests` | getApplicationActionRequestAnalytics | | `maitai analytics get-application-request` | GET | `/analytics/applications/{application_id}/requests` | getApplicationRequestAnalytics | | `maitai analytics get-company-application-activity` | GET | `/analytics/company/application-activity` | getCompanyApplicationActivityAnalytics | | `maitai analytics get-company-model-usage` | GET | `/analytics/company/model-usage` | getCompanyModelUsageAnalytics | | `maitai analytics get-company-request` | GET | `/analytics/company/requests` | getCompanyRequestAnalytics | | `maitai analytics get-intent-group-fault-rate` | GET | `/analytics/intent-groups/{intent_group_id}/fault-rate` | getIntentGroupFaultRateAnalytics | | `maitai analytics get-intent-group-request` | GET | `/analytics/intent-groups/{intent_group_id}/requests` | getIntentGroupRequestAnalytics | ### `maitai applications` | CLI command | Method | Path | Operation | | -------------------------------------------------- | ------ | -------------------------------------------------------------------------- | --------------------------- | | `maitai applications list` | GET | `/applications` | listApplications | | `maitai applications get` | GET | `/applications/{application_id}` | getApplication | | `maitai applications create` | POST | `/applications` | createApplication | | `maitai applications update` | PUT | `/applications/{application_id}` | updateApplication | | `maitai applications delete` | DELETE | `/applications/{application_id}` | deleteApplication | | `maitai applications get-config` | GET | `/applications/{application_id}/config` | getApplicationConfig | | `maitai applications update-config` | PUT | `/applications/{application_id}/config` | updateApplicationConfig | | `maitai applications reset-intent-config` | POST | `/applications/{application_id}/intents/{intent_id}/config/reset` | resetIntentConfig | | `maitai applications get-intent-config` | GET | `/applications/{application_id}/intents/{intent_id}/config` | getIntentConfig | | `maitai applications update-intent-config` | PUT | `/applications/{application_id}/intents/{intent_id}/config` | updateIntentConfig | | `maitai applications disable-intent-notifications` | PUT | `/applications/{application_id}/intents/{intent_id}/notifications/disable` | disableIntentNotifications | | `maitai applications enable-intent-notifications` | PUT | `/applications/{application_id}/intents/{intent_id}/notifications/enable` | enableIntentNotifications | | `maitai applications delete-intent` | DELETE | `/applications/{application_id}/intents/{intent_id}` | deleteApplicationIntent | | `maitai applications get-intent` | GET | `/applications/{application_id}/intents/{intent_id}` | getApplicationIntent | | `maitai applications list-intents` | GET | `/applications/{application_id}/intents` | listApplicationIntents | | `maitai applications create-intent` | POST | `/applications/{application_id}/intents` | createApplicationIntent | | `maitai applications list-models` | GET | `/applications/{application_id}/models` | listApplicationModels | | `maitai applications list-sessions` | GET | `/applications/{application_id}/sessions` | listApplicationSessions | | `maitai applications list-workflow-runs` | GET | `/applications/{application_id}/workflow-runs` | listApplicationWorkflowRuns | ### `maitai compositions` | CLI command | Method | Path | Operation | | ------------------------------------------------ | ------ | ----------------------------------------------------------------- | ----------------------------------- | | `maitai compositions list` | GET | `/compositions` | listCompositions | | `maitai compositions get` | GET | `/compositions/{composition_id}` | getComposition | | `maitai compositions create` | POST | `/compositions` | createComposition | | `maitai compositions update` | PUT | `/compositions/{composition_id}` | updateComposition | | `maitai compositions delete` | DELETE | `/compositions/{composition_id}` | deleteComposition | | `maitai compositions list-by-application-intent` | GET | `/compositions/applications/{application_id}/intents/{intent_id}` | listCompositionsByApplicationIntent | | `maitai compositions list-by-intent-group` | GET | `/compositions/intent-groups/{intent_group_id}` | listCompositionsByIntentGroup | | `maitai compositions validate-rl` | POST | `/compositions/validate-rl` | validateRlComposition | | `maitai compositions list-versions` | GET | `/compositions/{composition_id}/versions` | listCompositionVersions | ### `maitai conversation-trees` | CLI command | Method | Path | Operation | | ----------------------------------------- | ------ | ---------------------------------------- | ---------------------------- | | `maitai conversation-trees list` | GET | `/conversation-trees` | listConversationTrees | | `maitai conversation-trees get` | GET | `/conversation-trees/{tree_id}` | getConversationTree | | `maitai conversation-trees delete` | DELETE | `/conversation-trees/{tree_id}` | deleteConversationTree | | `maitai conversation-trees get-status` | GET | `/conversation-trees/{tree_id}/status` | getConversationTreeStatus | | `maitai conversation-trees list-versions` | GET | `/conversation-trees/{tree_id}/versions` | listConversationTreeVersions | ### `maitai dashboard` | CLI command | Method | Path | Operation | | ----------------------------------- | ------ | ------------------------- | -------------- | | `maitai dashboard get-action-items` | GET | `/dashboard/action-items` | getActionItems | | `maitai dashboard get-alerts` | GET | `/dashboard/alerts` | getAlerts | ### `maitai datasets` | CLI command | Method | Path | Operation | | --------------------------------------------------------- | ------ | ------------------------------------------------------------- | ------------------------------------------ | | `maitai datasets list` | GET | `/datasets` | listDatasets | | `maitai datasets get` | GET | `/datasets/{dataset_id}` | getDataset | | `maitai datasets create` | POST | `/datasets` | createDataset | | `maitai datasets update` | PUT | `/datasets/{dataset_id}` | updateDataset | | `maitai datasets delete` | DELETE | `/datasets/{dataset_id}` | deleteDataset | | `maitai datasets list-by-intent` | GET | `/datasets/applications/{application_id}/intents/{intent_id}` | listDatasetsByIntent | | `maitai datasets list-by-tags` | GET | `/datasets/by-tags` | listDatasetsByTags | | `maitai datasets get-estimated-request-count` | GET | `/datasets/estimated-request-count` | getEstimatedDatasetRequestCount | | `maitai datasets estimate-generation-cost` | POST | `/datasets/generate/estimate-cost` | estimateDatasetGenerationCost | | `maitai datasets preview-generation` | POST | `/datasets/generate/preview` | previewDatasetGeneration | | `maitai datasets start-generation` | POST | `/datasets/generate` | startDatasetGeneration | | `maitai datasets list-by-intent-group` | GET | `/datasets/intent-groups/{intent_group_id}` | listDatasetsByIntentGroup | | `maitai datasets get-3-syncer-info` | GET | `/datasets/s3/syncer-info` | getDatasetS3SyncerInfo | | `maitai datasets validate-3-source` | POST | `/datasets/s3/validate` | validateDatasetS3Source | | `maitai datasets list-valid-tags` | GET | `/datasets/tags/valid` | listValidDatasetTags | | `maitai datasets list-by-test-set` | GET | `/datasets/test-sets/{test_set_id}` | listDatasetsByTestSet | | `maitai datasets search-added-requests` | POST | `/datasets/{dataset_id}/added-requests/search` | searchAddedDatasetRequests | | `maitai datasets clone` | POST | `/datasets/{dataset_id}/clone` | cloneDataset | | `maitai datasets get-delete-impact` | GET | `/datasets/{dataset_id}/delete-impact` | getDatasetDeleteImpact | | `maitai datasets search-eligible-requests` | POST | `/datasets/{dataset_id}/eligible-requests/search` | searchEligibleDatasetRequests | | `maitai datasets list-eligible-requests` | GET | `/datasets/{dataset_id}/eligible-requests` | listEligibleDatasetRequests | | `maitai datasets cancel-generation` | POST | `/datasets/{dataset_id}/generate/cancel` | cancelDatasetGeneration | | `maitai datasets pause-generation` | POST | `/datasets/{dataset_id}/generate/pause` | pauseDatasetGeneration | | `maitai datasets resume-generation` | POST | `/datasets/{dataset_id}/generate/resume` | resumeDatasetGeneration | | `maitai datasets get-prompt` | GET | `/datasets/{dataset_id}/prompt` | getDatasetPrompt | | `maitai datasets apply-prune` | POST | `/datasets/{dataset_id}/prune/apply` | applyDatasetPrune | | `maitai datasets preview-prune` | POST | `/datasets/{dataset_id}/prune/preview` | previewDatasetPrune | | `maitai datasets augment-reasoning` | POST | `/datasets/{dataset_id}/reasoning/augment` | augmentDatasetReasoning | | `maitai datasets get-regex-replacements-applicable-count` | POST | `/datasets/{dataset_id}/regex-replacements/count` | getDatasetRegexReplacementsApplicableCount | | `maitai datasets apply-regex-replacements` | POST | `/datasets/{dataset_id}/regex-replacements` | applyDatasetRegexReplacements | | `maitai datasets get-request-distribution` | GET | `/datasets/{dataset_id}/request-distribution` | getDatasetRequestDistribution | | `maitai datasets list-request-ids` | GET | `/datasets/{dataset_id}/request-ids` | listDatasetRequestIds | | `maitai datasets add-requests-bulk` | PUT | `/datasets/{dataset_id}/requests/add` | addDatasetRequestsBulk | | `maitai datasets remove-requests-bulk` | PUT | `/datasets/{dataset_id}/requests/remove` | removeDatasetRequestsBulk | | `maitai datasets get-request-reasoning` | GET | `/datasets/{dataset_id}/requests/{request_id}/reasoning` | getDatasetRequestReasoning | | `maitai datasets remove-requests` | DELETE | `/datasets/{dataset_id}/requests` | removeRequestsFromDataset | | `maitai datasets list-requests` | GET | `/datasets/{dataset_id}/requests` | listDatasetRequests | | `maitai datasets add-requests` | POST | `/datasets/{dataset_id}/requests` | addRequestsToDataset | | `maitai datasets cancel-3-import` | POST | `/datasets/{dataset_id}/s3/cancel` | cancelDatasetS3Import | | `maitai datasets reimport-3-source` | POST | `/datasets/{dataset_id}/s3/reimport` | reimportDatasetS3Source | | `maitai datasets sample-clone` | POST | `/datasets/{dataset_id}/sample-clone` | sampleCloneDataset | | `maitai datasets get-status` | GET | `/datasets/{dataset_id}/status` | getDatasetStatus | | `maitai datasets remove-tag` | DELETE | `/datasets/{dataset_id}/tags/{tag}` | removeDatasetTag | | `maitai datasets list-tags` | GET | `/datasets/{dataset_id}/tags` | listDatasetTags | | `maitai datasets add-tag` | POST | `/datasets/{dataset_id}/tags` | addDatasetTag | | `maitai datasets set-tags` | PUT | `/datasets/{dataset_id}/tags` | setDatasetTags | | `maitai datasets list-versions` | GET | `/datasets/{dataset_id}/versions` | listDatasetVersions | ### `maitai evaluation-criteria` | CLI command | Method | Path | Operation | | ------------------------------------------- | ------ | ------------------------------------ | ------------------------------- | | `maitai evaluation-criteria list` | GET | `/evaluation-criteria` | listEvaluationCriteria | | `maitai evaluation-criteria create` | POST | `/evaluation-criteria` | createEvaluationCriteria | | `maitai evaluation-criteria update` | PUT | `/evaluation-criteria/{criteria_id}` | updateEvaluationCriteria | | `maitai evaluation-criteria delete` | DELETE | `/evaluation-criteria/{criteria_id}` | deleteEvaluationCriteria | | `maitai evaluation-criteria list-available` | GET | `/evaluation-criteria/available` | listAvailableEvaluationCriteria | ### `maitai evaluations` | CLI command | Method | Path | Operation | | -------------------------------- | ------ | ------------------------------------------ | -------------------- | | `maitai evaluations list` | GET | `/evaluations` | listEvaluations | | `maitai evaluations get` | GET | `/evaluations/{evaluation_run_id}` | getEvaluation | | `maitai evaluations create` | POST | `/evaluations` | createEvaluation | | `maitai evaluations get-results` | GET | `/evaluations/{evaluation_run_id}/results` | getEvaluationResults | ### `maitai external-test-runs` | CLI command | Method | Path | Operation | | ---------------------------------------------- | ------ | ------------------------------------------------------ | --------------------- | | `maitai external-test-runs create` | POST | `/external-test-runs` | createExternalTestRun | | `maitai external-test-runs lease-next-case` | GET | `/external-test-runs/{test_run_id}/next` | leaseNextCase | | `maitai external-test-runs submit-case-result` | POST | `/external-test-runs/{test_run_id}/{case_hash}/result` | submitCaseResult | ### `maitai finetune-runs` | CLI command | Method | Path | Operation | | ------------------------------------ | ------ | --------------------------------------- | --------------------- | | `maitai finetune-runs list` | GET | `/finetune-runs` | listFinetuneRuns | | `maitai finetune-runs get` | GET | `/finetune-runs/{run_id}` | getFinetuneRun | | `maitai finetune-runs create` | POST | `/finetune-runs` | createFinetuneRun | | `maitai finetune-runs estimate-vram` | POST | `/finetune-runs/estimate` | estimateFinetuneVram | | `maitai finetune-runs cancel` | POST | `/finetune-runs/{run_id}/cancel` | cancelFinetuneRun | | `maitai finetune-runs cancel-deploy` | POST | `/finetune-runs/{run_id}/deploy/cancel` | cancelFinetuneDeploy | | `maitai finetune-runs deploy` | POST | `/finetune-runs/{run_id}/deploy` | deployFinetuneRun | | `maitai finetune-runs get-metrics` | GET | `/finetune-runs/{run_id}/metrics` | getFinetuneRunMetrics | | `maitai finetune-runs get-status` | GET | `/finetune-runs/{run_id}/status` | getFinetuneStatus | ### `maitai help` | CLI command | Method | Path | Operation | | -------------------- | ------ | ------- | --------- | | `maitai help create` | POST | `/help` | helpQuery | ### `maitai intent-groups` | CLI command | Method | Path | Operation | | ---------------------------------------- | ------ | ----------------------------------------------- | --------------------------- | | `maitai intent-groups list` | GET | `/intent-groups` | listIntentGroups | | `maitai intent-groups get` | GET | `/intent-groups/{intent_group_id}` | getIntentGroup | | `maitai intent-groups list-compositions` | GET | `/intent-groups/{intent_group_id}/compositions` | listIntentGroupCompositions | | `maitai intent-groups get-config` | GET | `/intent-groups/{intent_group_id}/config` | getIntentGroupConfig | | `maitai intent-groups update-config` | PUT | `/intent-groups/{intent_group_id}/config` | updateIntentGroupConfig | | `maitai intent-groups list-datasets` | GET | `/intent-groups/{intent_group_id}/datasets` | listIntentGroupDatasets | | `maitai intent-groups list-intents` | GET | `/intent-groups/{intent_group_id}/intents` | listIntentsByGroup | | `maitai intent-groups list-models` | GET | `/intent-groups/{intent_group_id}/models` | listIntentGroupModels | | `maitai intent-groups list-requests` | GET | `/intent-groups/{intent_group_id}/requests` | listIntentGroupRequests | | `maitai intent-groups list-sentinels` | GET | `/intent-groups/{intent_group_id}/sentinels` | listIntentGroupSentinels | | `maitai intent-groups list-test-sets` | GET | `/intent-groups/{intent_group_id}/test-sets` | listIntentGroupTestSets | ### `maitai models` | CLI command | Method | Path | Operation | | ----------------------------------------------------- | ------ | ----------------------------------------------------- | -------------------------------------- | | `maitai models list` | GET | `/models` | listModels | | `maitai models get` | GET | `/models/{model_id}` | getModel | | `maitai models list-by-application` | GET | `/models/applications/{application_id}` | listModelsByApplication | | `maitai models list-available` | GET | `/models/available` | listAvailableModels | | `maitai models create-base` | POST | `/models/base-model` | createBaseModel | | `maitai models list-by-intent-group` | GET | `/models/intent-groups/{intent_group_id}` | listModelsByIntentGroup | | `maitai models list-by-intent` | GET | `/models/intents/{intent_id}` | listModelsByIntent | | `maitai models disable` | POST | `/models/{model_id}/disable` | disableModel | | `maitai models enable` | POST | `/models/{model_id}/enable` | enableModel | | `maitai models list-inference-pool-attach-candidates` | GET | `/models/{model_id}/inference-pool/attach-candidates` | listModelInferencePoolAttachCandidates | | `maitai models attach-inference-pool` | POST | `/models/{model_id}/inference-pool/attach` | attachModelInferencePool | | `maitai models get-inference-pool-debug` | GET | `/models/{model_id}/inference-pool/debug` | getModelInferencePoolDebug | | `maitai models detach-inference-pool` | POST | `/models/{model_id}/inference-pool/detach` | detachModelInferencePool | | `maitai models get-inference-pool` | GET | `/models/{model_id}/inference-pool` | getModelInferencePool | | `maitai models patch-registry` | PATCH | `/models/{model_id}/registry` | patchModelRegistry | | `maitai models get-repoint-options` | GET | `/models/{model_id}/repoint-options` | getModelRepointOptions | | `maitai models repoint` | POST | `/models/{model_id}/repoint` | repointModel | | `maitai models execute-swap-ref` | POST | `/models/{model_id}/swap-model-ref/execute` | executeSwapModelRef | | `maitai models preview-swap-ref` | POST | `/models/{model_id}/swap-model-ref/preview` | previewSwapModelRef | ### `maitai monitors` | CLI command | Method | Path | Operation | | -------------------------------------------------------------------------- | ------ | -------------------------------------------------------------- | ------------------------- | | `maitai monitors list` | GET | `/monitors` | listMonitors | | `maitai monitors get` | GET | `/monitors/{monitor_id}` | getMonitor | | `maitai monitors create` | POST | `/monitors` | createMonitor | | `maitai monitors update` | PUT | `/monitors/{monitor_id}` | updateMonitor | | `maitai monitors delete` | DELETE | `/monitors/{monitor_id}` | deleteMonitor | | `maitai monitors list-by-target` | GET | `/monitors/by-target` | listMonitorsByTarget | | `maitai monitors list-runs-by-source` | GET | `/monitors/runs/by-source` | listRunsBySource | | `maitai monitors get-run-global` | GET | `/monitors/runs/{run_id}` | getRunGlobal | | `maitai monitors list-runs-global` | GET | `/monitors/runs` | listRunsGlobal | | `maitai monitors get-target-sample` | GET | `/monitors/sample-target` | getTargetSample | | `maitai monitors activate` | POST | `/monitors/{monitor_id}/activate` | activateMonitor | | `maitai monitors get-activity` | GET | `/monitors/{monitor_id}/activity` | getMonitorActivity | | `maitai monitors get-metrics-by-target` | GET | `/monitors/{monitor_id}/metrics/by-target` | getMonitorMetricsByTarget | | `maitai monitors get-metrics` | GET | `/monitors/{monitor_id}/metrics` | getMonitorMetrics | | `maitai monitors pause` | POST | `/monitors/{monitor_id}/pause` | pauseMonitor | | `maitai monitors preview` | POST | `/monitors/{monitor_id}/preview` | previewMonitor | | `maitai monitors get-default-version` | GET | `/monitors/{monitor_id}/releases/default` | getDefaultMonitorVersion | | `maitai monitors promote-release` | POST | `/monitors/{monitor_id}/releases/{release_name}/promote` | promoteMonitorRelease | | `maitai monitors delete-release` | DELETE | `/monitors/{monitor_id}/releases/{release_name}` | deleteMonitorRelease | | `maitai monitors list-releases` | GET | `/monitors/{monitor_id}/releases` | listMonitorReleases | | `maitai monitors upsert-release` | POST | `/monitors/{monitor_id}/releases` | upsertMonitorRelease | | `maitai monitors upsert-release-put-monitor-id-releases` | PUT | `/monitors/{monitor_id}/releases` | upsertMonitorRelease | | `maitai monitors get-run-scoped` | GET | `/monitors/{monitor_id}/runs/{run_id}` | getRunScoped | | `maitai monitors list-runs` | GET | `/monitors/{monitor_id}/runs` | listRunsForMonitor | | `maitai monitors disable-target` | POST | `/monitors/{monitor_id}/targets/{monitor_target_id}/disable` | disableMonitorTarget | | `maitai monitors enable-target` | POST | `/monitors/{monitor_id}/targets/{monitor_target_id}/enable` | enableMonitorTarget | | `maitai monitors get-target-metrics` | GET | `/monitors/{monitor_id}/targets/{monitor_target_id}/metrics` | getMonitorTargetMetrics | | `maitai monitors get-target-sparkline` | GET | `/monitors/{monitor_id}/targets/{monitor_target_id}/sparkline` | getMonitorTargetSparkline | | `maitai monitors delete-target` | DELETE | `/monitors/{monitor_id}/targets/{monitor_target_id}` | deleteMonitorTarget | | `maitai monitors update-target-patch-monitor-id-targets-monitor-target-id` | PATCH | `/monitors/{monitor_id}/targets/{monitor_target_id}` | updateMonitorTarget | | `maitai monitors update-target` | PUT | `/monitors/{monitor_id}/targets/{monitor_target_id}` | updateMonitorTarget | | `maitai monitors list-targets` | GET | `/monitors/{monitor_id}/targets` | listMonitorTargets | | `maitai monitors create-target` | POST | `/monitors/{monitor_id}/targets` | createMonitorTarget | | `maitai monitors get-version` | GET | `/monitors/{monitor_id}/versions/{version_id}` | getMonitorVersion | | `maitai monitors list-versions` | GET | `/monitors/{monitor_id}/versions` | listMonitorVersions | | `maitai monitors publish-version` | POST | `/monitors/{monitor_id}/versions` | publishMonitorVersion | | `maitai monitors patch` | PATCH | `/monitors/{monitor_id}` | updateMonitor | ### `maitai reports` | CLI command | Method | Path | Operation | | ----------------------------------------- | ------ | ---------------------------------------- | --------------------- | | `maitai reports list-fallbacks` | GET | `/reports/fallbacks` | listFallbacks | | `maitai reports list-faults` | GET | `/reports/faults` | listFaults | | `maitai reports list-fallbacks-by-intent` | GET | `/reports/intents/{intent_id}/fallbacks` | listFallbacksByIntent | | `maitai reports list-faults-by-intent` | GET | `/reports/intents/{intent_id}/faults` | listFaultsByIntent | ### `maitai requests` | CLI command | Method | Path | Operation | | --------------------------------- | ------ | --------------------------------- | --------------------- | | `maitai requests list` | GET | `/requests` | listRequests | | `maitai requests get` | GET | `/requests/{request_id}` | getRequest | | `maitai requests update-response` | PUT | `/requests/{request_id}/response` | updateRequestResponse | ### `maitai search` | CLI command | Method | Path | Operation | | ---------------------- | ------ | --------- | --------- | | `maitai search create` | POST | `/search` | search | ### `maitai sentinels` | CLI command | Method | Path | Operation | | --------------------------------------------------------- | ------ | ------------------------------------------------------ | ------------------------------------ | | `maitai sentinels list` | GET | `/sentinels` | listSentinels | | `maitai sentinels get` | GET | `/sentinels/{sentinel_id}` | getSentinel | | `maitai sentinels create` | POST | `/sentinels` | createSentinel | | `maitai sentinels update` | PUT | `/sentinels/{sentinel_id}` | updateSentinel | | `maitai sentinels delete` | DELETE | `/sentinels/{sentinel_id}` | deleteSentinel | | `maitai sentinels list-by-application-human-needs` | GET | `/sentinels/applications/{application_id}/human-needs` | listSentinelsByApplicationHumanNeeds | | `maitai sentinels list-by-application` | GET | `/sentinels/applications/{application_id}` | listSentinelsByApplication | | `maitai sentinels generate-new` | POST | `/sentinels/generate/new` | generateNewSentinel | | `maitai sentinels generate` | POST | `/sentinels/generate` | generateSentinels | | `maitai sentinels list-by-intent-name` | GET | `/sentinels/intent-groups/by-name/{intent_name}` | listSentinelsByIntentName | | `maitai sentinels list-by-intent-group` | GET | `/sentinels/intent-groups/{intent_group_id}` | listSentinelsByIntentGroup | | `maitai sentinels regenerate` | POST | `/sentinels/regenerate` | regenerateSentinels | | `maitai sentinels list-simple` | GET | `/sentinels/simple` | listSimpleSentinels | | `maitai sentinels update-directive` | PUT | `/sentinels/{sentinel_id}/directive` | updateSentinelDirective | | `maitai sentinels regenerate-correction` | POST | `/sentinels/{sentinel_id}/regenerate/correction` | regenerateSentinelCorrection | | `maitai sentinels regenerate-evaluation` | POST | `/sentinels/{sentinel_id}/regenerate/evaluation` | regenerateSentinelEvaluation | | `maitai sentinels regenerate-qualification` | POST | `/sentinels/{sentinel_id}/regenerate/qualification` | regenerateSentinelQualification | | `maitai sentinels regenerate-post-sentinel-id-regenerate` | POST | `/sentinels/{sentinel_id}/regenerate` | regenerateSentinel | ### `maitai sessions` | CLI command | Method | Path | Operation | | ------------------------------ | ------ | --------------------------------- | ------------------ | | `maitai sessions list` | GET | `/sessions` | listSessions | | `maitai sessions get` | GET | `/sessions/{session_id}` | getSession | | `maitai sessions set-feedback` | POST | `/sessions/{session_id}/feedback` | setSessionFeedback | | `maitai sessions get-timeline` | GET | `/sessions/{session_id}/timeline` | getSessionTimeline | ### `maitai test-runs` | CLI command | Method | Path | Operation | | --------------------------------------------- | ------ | -------------------------------------------------------------------- | ------------------------------ | | `maitai test-runs list` | GET | `/test-runs` | listTestRuns | | `maitai test-runs get` | GET | `/test-runs/{test_run_id}` | getTestRun | | `maitai test-runs create` | POST | `/test-runs` | createTestRun | | `maitai test-runs delete` | DELETE | `/test-runs/{test_run_id}` | deleteTestRun | | `maitai test-runs compare` | POST | `/test-runs/compare` | compareTestRuns | | `maitai test-runs list-by-intent-group` | GET | `/test-runs/intent-groups/{intent_group_id}` | listTestRunsByIntentGroup | | `maitai test-runs get-request-comparison` | GET | `/test-runs/requests/compare/{base_request_id}/{compare_request_id}` | getTestRunRequestComparison | | `maitai test-runs get-progress-by-set` | GET | `/test-runs/test-sets/{test_set_id}/progress` | getTestRunProgressByTestSet | | `maitai test-runs list-by-set` | GET | `/test-runs/test-sets/{test_set_id}` | listTestRunsByTestSet | | `maitai test-runs evaluate` | POST | `/test-runs/{test_run_id}/evaluate` | evaluateTestRun | | `maitai test-runs update-item` | PUT | `/test-runs/{test_run_id}/items/{item_id}` | updateTestRunItem | | `maitai test-runs list-items` | GET | `/test-runs/{test_run_id}/items` | listTestRunItems | | `maitai test-runs get-progress` | GET | `/test-runs/{test_run_id}/progress` | getTestRunProgress | | `maitai test-runs re-evaluate` | POST | `/test-runs/{test_run_id}/re-evaluate` | reEvaluateTestRun | | `maitai test-runs list-requests-with-filters` | POST | `/test-runs/{test_run_id}/requests/{offset}/{limit}` | listTestRunRequestsWithFilters | | `maitai test-runs evaluate-request` | POST | `/test-runs/{test_run_id}/requests/{test_run_request_id}/evaluate` | evaluateTestRunRequest | | `maitai test-runs list-requests` | GET | `/test-runs/{test_run_id}/requests` | listTestRunRequests | | `maitai test-runs get-results` | GET | `/test-runs/{test_run_id}/results` | getTestRunResults | | `maitai test-runs resume` | POST | `/test-runs/{test_run_id}/resume` | resumeTestRun | | `maitai test-runs retry` | POST | `/test-runs/{test_run_id}/retry` | retryTestRun | | `maitai test-runs list-review-segments` | GET | `/test-runs/{test_run_id}/review-segments` | listTestRunReviewSegments | | `maitai test-runs update-status` | PUT | `/test-runs/{test_run_id}/status/{status}` | updateTestRunStatus | | `maitai test-runs stop` | POST | `/test-runs/{test_run_id}/stop` | stopTestRun | ### `maitai test-set-jobs` | CLI command | Method | Path | Operation | | -------------------------- | ------ | ------------------------- | ------------- | | `maitai test-set-jobs get` | GET | `/test-set-jobs/{job_id}` | getTestSetJob | ### `maitai test-sets` | CLI command | Method | Path | Operation | | ----------------------------------------------- | ------ | --------------------------------------------------------------------- | -------------------------------- | | `maitai test-sets list` | GET | `/test-sets` | listTestSets | | `maitai test-sets get` | GET | `/test-sets/{test_set_id}` | getTestSet | | `maitai test-sets create` | POST | `/test-sets` | createTestSet | | `maitai test-sets update` | PUT | `/test-sets/{test_set_id}` | updateTestSet | | `maitai test-sets delete` | DELETE | `/test-sets/{test_set_id}` | deleteTestSet | | `maitai test-sets list-by-application-intent` | GET | `/test-sets/applications/{application_id}/intents/{intent_id}` | listTestSetsByApplicationIntent | | `maitai test-sets convert-to-workflow` | POST | `/test-sets/convert-to-workflow` | convertTestSetToWorkflow | | `maitai test-sets convert-workflow-to-requests` | POST | `/test-sets/convert-workflow-to-requests` | convertWorkflowTestSetToRequests | | `maitai test-sets list-created-from-dataset` | GET | `/test-sets/datasets/{dataset_id}/source` | listTestSetsCreatedFromDataset | | `maitai test-sets list-by-dataset` | GET | `/test-sets/datasets/{dataset_id}` | listTestSetsByDataset | | `maitai test-sets search-eligible-requests` | POST | `/test-sets/eligible-requests/{intent_group_id}/{test_set_id}/search` | searchEligibleTestSetRequests | | `maitai test-sets list-eligible-requests` | GET | `/test-sets/eligible-requests/{intent_group_id}/{test_set_id}` | listEligibleTestSetRequests | | `maitai test-sets list-by-intent-group-name` | GET | `/test-sets/intent-groups/by-name/{intent_group_name}` | listTestSetsByIntentGroupName | | `maitai test-sets list-by-intent-group` | GET | `/test-sets/intent-groups/{intent_group_id}` | listTestSetsByIntentGroup | | `maitai test-sets add-single-request` | PUT | `/test-sets/request/add` | addSingleRequestToTestSet | | `maitai test-sets remove-single-request` | DELETE | `/test-sets/request/remove` | removeSingleRequestFromTestSet | | `maitai test-sets add-requests-bulk` | PUT | `/test-sets/requests/add` | addTestSetRequestsBulk | | `maitai test-sets remove-requests-bulk` | PUT | `/test-sets/requests/remove` | removeTestSetRequestsBulk | | `maitai test-sets clone` | POST | `/test-sets/{test_set_id}/clone` | cloneTestSet | | `maitai test-sets list-imported-session-ids` | GET | `/test-sets/{test_set_id}/imported-session-ids` | listTestSetImportedSessionIds | | `maitai test-sets delete-item-response-sub` | DELETE | `/test-sets/{test_set_id}/items/{item_id}/response-sub` | deleteTestSetItemResponseSub | | `maitai test-sets get-item-response-sub` | GET | `/test-sets/{test_set_id}/items/{item_id}/response-sub` | getTestSetItemResponseSub | | `maitai test-sets upsert-item-response-sub` | PUT | `/test-sets/{test_set_id}/items/{item_id}/response-sub` | upsertTestSetItemResponseSub | | `maitai test-sets delete-item` | DELETE | `/test-sets/{test_set_id}/items/{item_id}` | deleteTestSetItem | | `maitai test-sets remove-items` | DELETE | `/test-sets/{test_set_id}/items` | removeTestSetItems | | `maitai test-sets list-items` | GET | `/test-sets/{test_set_id}/items` | listTestSetItems | | `maitai test-sets add-items` | POST | `/test-sets/{test_set_id}/items` | addTestSetItems | | `maitai test-sets get-prompt-template` | GET | `/test-sets/{test_set_id}/prompt-template` | getTestSetPromptTemplate | | `maitai test-sets get-request-distribution` | GET | `/test-sets/{test_set_id}/request-distribution` | getTestSetRequestDistribution | | `maitai test-sets update-request-response` | PUT | `/test-sets/{test_set_id}/requests/{request_id}/response` | updateTestSetRequestResponse | | `maitai test-sets update-request-tags` | PUT | `/test-sets/{test_set_id}/requests/{request_id}/tags` | updateTestSetRequestTags | | `maitai test-sets remove-requests` | DELETE | `/test-sets/{test_set_id}/requests` | removeRequestsFromTestSet | | `maitai test-sets list-requests` | GET | `/test-sets/{test_set_id}/requests` | listTestSetRequests | | `maitai test-sets add-requests` | POST | `/test-sets/{test_set_id}/requests` | addRequestsToTestSet | | `maitai test-sets list-session-facets` | GET | `/test-sets/{test_set_id}/sessions` | listTestSetSessionFacets | ### `maitai unified-test-runs` | CLI command | Method | Path | Operation | | ------------------------------------------------ | ------ | ----------------------------------------------- | ------------------------------ | | `maitai unified-test-runs list` | GET | `/unified-test-runs` | listUnifiedTestRuns | | `maitai unified-test-runs get` | GET | `/unified-test-runs/{test_run_id}` | getUnifiedTestRun | | `maitai unified-test-runs create` | POST | `/unified-test-runs` | createUnifiedTestRun | | `maitai unified-test-runs delete` | DELETE | `/unified-test-runs/{test_run_id}` | deleteUnifiedTestRun | | `maitai unified-test-runs preview-adapted-input` | POST | `/unified-test-runs/preview-adapted-input` | previewAdaptedInput | | `maitai unified-test-runs cancel` | POST | `/unified-test-runs/{test_run_id}/cancel` | cancelUnifiedTestRun | | `maitai unified-test-runs execute` | POST | `/unified-test-runs/{test_run_id}/execute` | executeUnifiedTestRun | | `maitai unified-test-runs list-items` | GET | `/unified-test-runs/{test_run_id}/items` | listUnifiedTestRunItems | | `maitai unified-test-runs prepare` | POST | `/unified-test-runs/{test_run_id}/prepare` | prepareUnifiedTestRun | | `maitai unified-test-runs get-progress` | GET | `/unified-test-runs/{test_run_id}/progress` | getUnifiedTestRunProgress | | `maitai unified-test-runs reset-failed-items` | POST | `/unified-test-runs/{test_run_id}/reset-failed` | resetFailedUnifiedTestRunItems | | `maitai unified-test-runs score` | POST | `/unified-test-runs/{test_run_id}/score` | scoreUnifiedTestRun | ### `maitai unified-test-sets` | CLI command | Method | Path | Operation | | --------------------------------------------------------------- | ------ | --------------------------------------------------------------------------- | ---------------------------------------------- | | `maitai unified-test-sets list` | GET | `/unified-test-sets` | listUnifiedTestSets | | `maitai unified-test-sets get` | GET | `/unified-test-sets/{test_set_id}` | getUnifiedTestSet | | `maitai unified-test-sets create` | POST | `/unified-test-sets` | createUnifiedTestSet | | `maitai unified-test-sets upload-jsonl` | POST | `/unified-test-sets/upload` | uploadUnifiedTestSetJsonl | | `maitai unified-test-sets clone` | POST | `/unified-test-sets/{test_set_id}/clone` | cloneUnifiedTestSet | | `maitai unified-test-sets import-agent-task-into` | POST | `/unified-test-sets/{test_set_id}/import-agent-task` | importAgentTaskIntoUnifiedTestSet | | `maitai unified-test-sets import-request-into` | POST | `/unified-test-sets/{test_set_id}/import-request` | importRequestIntoUnifiedTestSet | | `maitai unified-test-sets import-workflow-run-into` | POST | `/unified-test-sets/{test_set_id}/import-workflow-run` | importWorkflowRunIntoUnifiedTestSet | | `maitai unified-test-sets upsert-item-expected-output-override` | PUT | `/unified-test-sets/{test_set_id}/items/{item_id}/expected-output-override` | upsertUnifiedTestSetItemExpectedOutputOverride | | `maitai unified-test-sets delete-item` | DELETE | `/unified-test-sets/{test_set_id}/items/{item_id}` | deleteUnifiedTestSetItem | | `maitai unified-test-sets get-item` | GET | `/unified-test-sets/{test_set_id}/items/{item_id}` | getUnifiedTestSetItem | | `maitai unified-test-sets list-items` | GET | `/unified-test-sets/{test_set_id}/items` | listUnifiedTestSetItems | | `maitai unified-test-sets create-manual-item` | POST | `/unified-test-sets/{test_set_id}/items` | createUnifiedManualTestSetItem | | `maitai unified-test-sets patch` | PATCH | `/unified-test-sets/{test_set_id}` | patchUnifiedTestSet | ### `maitai workflows` | CLI command | Method | Path | Operation | | --------------------------------------------- | ------ | ------------------------------------------------------------------- | ------------------------------- | | `maitai workflows list` | GET | `/workflows` | listWorkflows | | `maitai workflows get` | GET | `/workflows/{workflow_id}` | getWorkflow | | `maitai workflows create` | POST | `/workflows` | createWorkflow | | `maitai workflows update` | PUT | `/workflows/{workflow_id}` | updateWorkflow | | `maitai workflows delete` | DELETE | `/workflows/{workflow_id}` | deleteWorkflow | | `maitai workflows create-chat-completion` | POST | `/workflows/chat/completions` | createWorkflowChatCompletion | | `maitai workflows get-default-script` | GET | `/workflows/default-script` | getDefaultWorkflowScript | | `maitai workflows log-run` | PUT | `/workflows/runs/log` | logWorkflowRun | | `maitai workflows get-run` | GET | `/workflows/runs/{session_id}` | getWorkflowRun | | `maitai workflows list-runs` | GET | `/workflows/runs` | listWorkflowRuns | | `maitai workflows upload-bundle` | POST | `/workflows/upload` | uploadWorkflowBundle | | `maitai workflows validate-script` | POST | `/workflows/validate` | validateWorkflowScript | | `maitai workflows delete-accessory` | DELETE | `/workflows/{workflow_id}/accessories` | deleteWorkflowAccessory | | `maitai workflows upload-accessory` | POST | `/workflows/{workflow_id}/accessories` | uploadWorkflowAccessory | | `maitai workflows get-artifact-files` | GET | `/workflows/{workflow_id}/artifact-files` | getWorkflowArtifactFiles | | `maitai workflows upload-datastore` | POST | `/workflows/{workflow_id}/datastores/{name}/upload` | uploadWorkflowDatastore | | `maitai workflows delete-datastore` | DELETE | `/workflows/{workflow_id}/datastores/{name}` | deleteWorkflowDatastore | | `maitai workflows upsert-datastore` | POST | `/workflows/{workflow_id}/datastores/{name}` | upsertWorkflowDatastore | | `maitai workflows list-datastores` | GET | `/workflows/{workflow_id}/datastores` | listWorkflowDatastores | | `maitai workflows check-transforms` | GET | `/workflows/{workflow_id}/has-transforms` | checkWorkflowTransforms | | `maitai workflows clear-default-release` | POST | `/workflows/{workflow_id}/releases/clear-default` | clearWorkflowDefaultRelease | | `maitai workflows delete-release` | DELETE | `/workflows/{workflow_id}/releases/{name}` | deleteWorkflowRelease | | `maitai workflows update-release` | PUT | `/workflows/{workflow_id}/releases/{name}` | updateWorkflowRelease | | `maitai workflows list-releases` | GET | `/workflows/{workflow_id}/releases` | listWorkflowReleases | | `maitai workflows create-release` | POST | `/workflows/{workflow_id}/releases` | createWorkflowRelease | | `maitai workflows get-schema` | GET | `/workflows/{workflow_id}/schema` | getWorkflowSchema | | `maitai workflows get-script` | GET | `/workflows/{workflow_id}/script` | getWorkflowScript | | `maitai workflows get-transform-info` | GET | `/workflows/{workflow_id}/transform-info` | getWorkflowTransformInfo | | `maitai workflows preview-transform` | POST | `/workflows/{workflow_id}/transform-preview` | previewWorkflowTransform | | `maitai workflows get-version-artifact-files` | GET | `/workflows/{workflow_id}/versions/{version_number}/artifact-files` | getWorkflowVersionArtifactFiles | | `maitai workflows list-versions` | GET | `/workflows/{workflow_id}/versions` | listWorkflowVersions | | `maitai workflows publish-version` | POST | `/workflows/{workflow_id}/versions` | publishWorkflowVersion | ## All endpoints The CLI wraps all api/v1 endpoints. Use `maitai api METHOD path` for any endpoint: | Method | Path | Operation | | ------ | --------------------------------------------------------------------------- | ---------------------------------------------- | | GET | `/agents` | listAgents | | POST | `/agents` | createAgent | | DELETE | `/agents/actions/{action_id}` | deleteAgentAction | | GET | `/agents/actions/{action_id}` | getAgentAction | | PATCH | `/agents/actions/{action_id}` | patchAgentAction | | PUT | `/agents/actions/{action_id}` | updateAgentAction | | PUT | `/agents/actions/{action_id}/disable` | disableAction | | PUT | `/agents/actions/{action_id}/enable` | enableAction | | POST | `/agents/actions/{action_id}/publish` | publishActionVersion | | GET | `/agents/actions/{action_id}/versions` | listActionVersions | | POST | `/agents/actions/{action_id}/versions/{version}/restore` | restoreActionVersion | | POST | `/agents/import` | importAgents | | GET | `/agents/supplied-actions` | listSuppliedActions | | GET | `/agents/tasks/{task_id}/tree` | getAgentTaskTree | | DELETE | `/agents/{agent_id}` | deleteAgent | | GET | `/agents/{agent_id}` | getAgent | | PATCH | `/agents/{agent_id}` | patchAgent | | PUT | `/agents/{agent_id}` | updateAgent | | GET | `/agents/{agent_id}/actions` | listAgentActions | | POST | `/agents/{agent_id}/actions` | createAgentAction | | POST | `/agents/{agent_id}/actions/supplied/{catalog_action_id}` | addSuppliedAction | | DELETE | `/agents/{agent_id}/form-fields` | deleteFormFields | | GET | `/agents/{agent_id}/form-fields` | getFormFields | | PUT | `/agents/{agent_id}/form-fields` | updateFormFields | | GET | `/agents/{agent_id}/invocations/{task_id}` | getAgentInvocation | | POST | `/agents/{agent_id}/invoke` | invokeAgent | | POST | `/agents/{agent_id}/publish` | publishAgentVersion | | GET | `/agents/{agent_id}/releases` | listAgentReleases | | DELETE | `/agents/{agent_id}/releases/{name}` | deleteAgentRelease | | PUT | `/agents/{agent_id}/releases/{name}` | upsertAgentRelease | | GET | `/agents/{agent_id}/routing/config` | getRoutingConfig | | PUT | `/agents/{agent_id}/routing/config` | updateRoutingConfig | | GET | `/agents/{agent_id}/routing/results/{routing_result_id}` | getRoutingResult | | POST | `/agents/{agent_id}/routing/rules` | createRoutingRule | | DELETE | `/agents/{agent_id}/routing/rules/{rule_id}` | deleteRoutingRule | | PUT | `/agents/{agent_id}/routing/rules/{rule_id}` | updateRoutingRule | | PUT | `/agents/{agent_id}/routing/rules/{rule_id}/reorder` | reorderRoutingRule | | POST | `/agents/{agent_id}/routing/rules/{rule_id}/test` | testRoutingRule | | GET | `/agents/{agent_id}/sessions` | listAgentSessions | | GET | `/agents/{agent_id}/sessions/{session_id}` | getAgentSessionDetail | | GET | `/agents/{agent_id}/sessions/{session_id}/timeline` | getAgentSessionTimeline | | GET | `/agents/{agent_id}/status` | getAgentStatus | | GET | `/agents/{agent_id}/subagents` | listSubAgents | | POST | `/agents/{agent_id}/subagents` | addSubAgent | | DELETE | `/agents/{agent_id}/subagents/{child_agent_id}` | removeSubAgent | | PUT | `/agents/{agent_id}/subagents/{child_agent_id}/disable` | disableSubAgent | | PUT | `/agents/{agent_id}/subagents/{child_agent_id}/enable` | enableSubAgent | | GET | `/agents/{agent_id}/system-steps` | listAgentSystemSteps | | DELETE | `/agents/{agent_id}/system-steps/{step}/config` | resetAgentSystemStepConfig | | GET | `/agents/{agent_id}/system-steps/{step}/config` | getAgentSystemStepConfig | | PUT | `/agents/{agent_id}/system-steps/{step}/config` | updateAgentSystemStepConfig | | PUT | `/agents/{agent_id}/system-steps/{step}/disable` | disableAgentSystemStep | | PUT | `/agents/{agent_id}/system-steps/{step}/enable` | enableAgentSystemStep | | DELETE | `/agents/{agent_id}/system-steps/{step}/prompt` | resetAgentSystemStepPrompt | | GET | `/agents/{agent_id}/system-steps/{step}/prompt` | getAgentSystemStepPrompt | | PUT | `/agents/{agent_id}/system-steps/{step}/prompt` | updateAgentSystemStepPrompt | | GET | `/agents/{agent_id}/tasks/{task_id}/timeline` | getAgentTaskTimeline | | GET | `/agents/{agent_id}/versions` | listAgentVersions | | GET | `/agents/{agent_id}/versions/diff` | diffAgentVersions | | GET | `/agents/{agent_id}/versions/{version}` | getAgentVersion | | POST | `/agents/{agent_id}/versions/{version}/restore` | restoreAgentVersion | | GET | `/analytics/agents/{agent_id}/requests` | getAgentRequestAnalytics | | GET | `/analytics/applications/{application_id}/fault-rate` | getApplicationFaultRateAnalytics | | GET | `/analytics/applications/{application_id}/intents/{action_id}/fault-rate` | getApplicationActionFaultRateAnalytics | | GET | `/analytics/applications/{application_id}/intents/{action_id}/requests` | getApplicationActionRequestAnalytics | | GET | `/analytics/applications/{application_id}/requests` | getApplicationRequestAnalytics | | GET | `/analytics/company/application-activity` | getCompanyApplicationActivityAnalytics | | GET | `/analytics/company/model-usage` | getCompanyModelUsageAnalytics | | GET | `/analytics/company/requests` | getCompanyRequestAnalytics | | GET | `/analytics/intent-groups/{intent_group_id}/fault-rate` | getIntentGroupFaultRateAnalytics | | GET | `/analytics/intent-groups/{intent_group_id}/requests` | getIntentGroupRequestAnalytics | | GET | `/applications` | listApplications | | POST | `/applications` | createApplication | | DELETE | `/applications/{application_id}` | deleteApplication | | GET | `/applications/{application_id}` | getApplication | | PUT | `/applications/{application_id}` | updateApplication | | GET | `/applications/{application_id}/config` | getApplicationConfig | | PUT | `/applications/{application_id}/config` | updateApplicationConfig | | GET | `/applications/{application_id}/intents` | listApplicationIntents | | POST | `/applications/{application_id}/intents` | createApplicationIntent | | DELETE | `/applications/{application_id}/intents/{intent_id}` | deleteApplicationIntent | | GET | `/applications/{application_id}/intents/{intent_id}` | getApplicationIntent | | GET | `/applications/{application_id}/intents/{intent_id}/config` | getIntentConfig | | PUT | `/applications/{application_id}/intents/{intent_id}/config` | updateIntentConfig | | POST | `/applications/{application_id}/intents/{intent_id}/config/reset` | resetIntentConfig | | PUT | `/applications/{application_id}/intents/{intent_id}/notifications/disable` | disableIntentNotifications | | PUT | `/applications/{application_id}/intents/{intent_id}/notifications/enable` | enableIntentNotifications | | GET | `/applications/{application_id}/models` | listApplicationModels | | GET | `/applications/{application_id}/sessions` | listApplicationSessions | | GET | `/applications/{application_id}/workflow-runs` | listApplicationWorkflowRuns | | GET | `/compositions` | listCompositions | | POST | `/compositions` | createComposition | | GET | `/compositions/applications/{application_id}/intents/{intent_id}` | listCompositionsByApplicationIntent | | GET | `/compositions/intent-groups/{intent_group_id}` | listCompositionsByIntentGroup | | POST | `/compositions/validate-rl` | validateRlComposition | | DELETE | `/compositions/{composition_id}` | deleteComposition | | GET | `/compositions/{composition_id}` | getComposition | | PUT | `/compositions/{composition_id}` | updateComposition | | GET | `/compositions/{composition_id}/versions` | listCompositionVersions | | GET | `/conversation-trees` | listConversationTrees | | DELETE | `/conversation-trees/{tree_id}` | deleteConversationTree | | GET | `/conversation-trees/{tree_id}` | getConversationTree | | GET | `/conversation-trees/{tree_id}/status` | getConversationTreeStatus | | GET | `/conversation-trees/{tree_id}/versions` | listConversationTreeVersions | | GET | `/dashboard/action-items` | getActionItems | | GET | `/dashboard/alerts` | getAlerts | | GET | `/datasets` | listDatasets | | POST | `/datasets` | createDataset | | GET | `/datasets/applications/{application_id}/intents/{intent_id}` | listDatasetsByIntent | | GET | `/datasets/by-tags` | listDatasetsByTags | | GET | `/datasets/estimated-request-count` | getEstimatedDatasetRequestCount | | POST | `/datasets/generate` | startDatasetGeneration | | POST | `/datasets/generate/estimate-cost` | estimateDatasetGenerationCost | | POST | `/datasets/generate/preview` | previewDatasetGeneration | | GET | `/datasets/intent-groups/{intent_group_id}` | listDatasetsByIntentGroup | | GET | `/datasets/s3/syncer-info` | getDatasetS3SyncerInfo | | POST | `/datasets/s3/validate` | validateDatasetS3Source | | GET | `/datasets/tags/valid` | listValidDatasetTags | | GET | `/datasets/test-sets/{test_set_id}` | listDatasetsByTestSet | | DELETE | `/datasets/{dataset_id}` | deleteDataset | | GET | `/datasets/{dataset_id}` | getDataset | | PUT | `/datasets/{dataset_id}` | updateDataset | | POST | `/datasets/{dataset_id}/added-requests/search` | searchAddedDatasetRequests | | POST | `/datasets/{dataset_id}/clone` | cloneDataset | | GET | `/datasets/{dataset_id}/delete-impact` | getDatasetDeleteImpact | | GET | `/datasets/{dataset_id}/eligible-requests` | listEligibleDatasetRequests | | POST | `/datasets/{dataset_id}/eligible-requests/search` | searchEligibleDatasetRequests | | POST | `/datasets/{dataset_id}/generate/cancel` | cancelDatasetGeneration | | POST | `/datasets/{dataset_id}/generate/pause` | pauseDatasetGeneration | | POST | `/datasets/{dataset_id}/generate/resume` | resumeDatasetGeneration | | GET | `/datasets/{dataset_id}/prompt` | getDatasetPrompt | | POST | `/datasets/{dataset_id}/prune/apply` | applyDatasetPrune | | POST | `/datasets/{dataset_id}/prune/preview` | previewDatasetPrune | | POST | `/datasets/{dataset_id}/reasoning/augment` | augmentDatasetReasoning | | POST | `/datasets/{dataset_id}/regex-replacements` | applyDatasetRegexReplacements | | POST | `/datasets/{dataset_id}/regex-replacements/count` | getDatasetRegexReplacementsApplicableCount | | GET | `/datasets/{dataset_id}/request-distribution` | getDatasetRequestDistribution | | GET | `/datasets/{dataset_id}/request-ids` | listDatasetRequestIds | | DELETE | `/datasets/{dataset_id}/requests` | removeRequestsFromDataset | | GET | `/datasets/{dataset_id}/requests` | listDatasetRequests | | POST | `/datasets/{dataset_id}/requests` | addRequestsToDataset | | PUT | `/datasets/{dataset_id}/requests/add` | addDatasetRequestsBulk | | PUT | `/datasets/{dataset_id}/requests/remove` | removeDatasetRequestsBulk | | GET | `/datasets/{dataset_id}/requests/{request_id}/reasoning` | getDatasetRequestReasoning | | POST | `/datasets/{dataset_id}/s3/cancel` | cancelDatasetS3Import | | POST | `/datasets/{dataset_id}/s3/reimport` | reimportDatasetS3Source | | POST | `/datasets/{dataset_id}/sample-clone` | sampleCloneDataset | | GET | `/datasets/{dataset_id}/status` | getDatasetStatus | | GET | `/datasets/{dataset_id}/tags` | listDatasetTags | | POST | `/datasets/{dataset_id}/tags` | addDatasetTag | | PUT | `/datasets/{dataset_id}/tags` | setDatasetTags | | DELETE | `/datasets/{dataset_id}/tags/{tag}` | removeDatasetTag | | GET | `/datasets/{dataset_id}/versions` | listDatasetVersions | | GET | `/evaluation-criteria` | listEvaluationCriteria | | POST | `/evaluation-criteria` | createEvaluationCriteria | | GET | `/evaluation-criteria/available` | listAvailableEvaluationCriteria | | DELETE | `/evaluation-criteria/{criteria_id}` | deleteEvaluationCriteria | | PUT | `/evaluation-criteria/{criteria_id}` | updateEvaluationCriteria | | GET | `/evaluations` | listEvaluations | | POST | `/evaluations` | createEvaluation | | GET | `/evaluations/{evaluation_run_id}` | getEvaluation | | GET | `/evaluations/{evaluation_run_id}/results` | getEvaluationResults | | POST | `/external-test-runs` | createExternalTestRun | | GET | `/external-test-runs/{test_run_id}/next` | leaseNextCase | | POST | `/external-test-runs/{test_run_id}/{case_hash}/result` | submitCaseResult | | GET | `/finetune-runs` | listFinetuneRuns | | POST | `/finetune-runs` | createFinetuneRun | | POST | `/finetune-runs/estimate` | estimateFinetuneVram | | GET | `/finetune-runs/{run_id}` | getFinetuneRun | | POST | `/finetune-runs/{run_id}/cancel` | cancelFinetuneRun | | POST | `/finetune-runs/{run_id}/deploy` | deployFinetuneRun | | POST | `/finetune-runs/{run_id}/deploy/cancel` | cancelFinetuneDeploy | | GET | `/finetune-runs/{run_id}/metrics` | getFinetuneRunMetrics | | GET | `/finetune-runs/{run_id}/status` | getFinetuneStatus | | POST | `/help` | helpQuery | | GET | `/intent-groups` | listIntentGroups | | GET | `/intent-groups/{intent_group_id}` | getIntentGroup | | GET | `/intent-groups/{intent_group_id}/compositions` | listIntentGroupCompositions | | GET | `/intent-groups/{intent_group_id}/config` | getIntentGroupConfig | | PUT | `/intent-groups/{intent_group_id}/config` | updateIntentGroupConfig | | GET | `/intent-groups/{intent_group_id}/datasets` | listIntentGroupDatasets | | GET | `/intent-groups/{intent_group_id}/intents` | listIntentsByGroup | | GET | `/intent-groups/{intent_group_id}/models` | listIntentGroupModels | | GET | `/intent-groups/{intent_group_id}/requests` | listIntentGroupRequests | | GET | `/intent-groups/{intent_group_id}/sentinels` | listIntentGroupSentinels | | GET | `/intent-groups/{intent_group_id}/test-sets` | listIntentGroupTestSets | | GET | `/models` | listModels | | GET | `/models/applications/{application_id}` | listModelsByApplication | | GET | `/models/available` | listAvailableModels | | POST | `/models/base-model` | createBaseModel | | GET | `/models/intent-groups/{intent_group_id}` | listModelsByIntentGroup | | GET | `/models/intents/{intent_id}` | listModelsByIntent | | GET | `/models/{model_id}` | getModel | | POST | `/models/{model_id}/disable` | disableModel | | POST | `/models/{model_id}/enable` | enableModel | | GET | `/models/{model_id}/inference-pool` | getModelInferencePool | | POST | `/models/{model_id}/inference-pool/attach` | attachModelInferencePool | | GET | `/models/{model_id}/inference-pool/attach-candidates` | listModelInferencePoolAttachCandidates | | GET | `/models/{model_id}/inference-pool/debug` | getModelInferencePoolDebug | | POST | `/models/{model_id}/inference-pool/detach` | detachModelInferencePool | | PATCH | `/models/{model_id}/registry` | patchModelRegistry | | POST | `/models/{model_id}/repoint` | repointModel | | GET | `/models/{model_id}/repoint-options` | getModelRepointOptions | | POST | `/models/{model_id}/swap-model-ref/execute` | executeSwapModelRef | | POST | `/models/{model_id}/swap-model-ref/preview` | previewSwapModelRef | | GET | `/monitors` | listMonitors | | POST | `/monitors` | createMonitor | | GET | `/monitors/by-target` | listMonitorsByTarget | | GET | `/monitors/runs` | listRunsGlobal | | GET | `/monitors/runs/by-source` | listRunsBySource | | GET | `/monitors/runs/{run_id}` | getRunGlobal | | GET | `/monitors/sample-target` | getTargetSample | | DELETE | `/monitors/{monitor_id}` | deleteMonitor | | GET | `/monitors/{monitor_id}` | getMonitor | | PATCH | `/monitors/{monitor_id}` | updateMonitor | | PUT | `/monitors/{monitor_id}` | updateMonitor | | POST | `/monitors/{monitor_id}/activate` | activateMonitor | | GET | `/monitors/{monitor_id}/activity` | getMonitorActivity | | GET | `/monitors/{monitor_id}/metrics` | getMonitorMetrics | | GET | `/monitors/{monitor_id}/metrics/by-target` | getMonitorMetricsByTarget | | POST | `/monitors/{monitor_id}/pause` | pauseMonitor | | POST | `/monitors/{monitor_id}/preview` | previewMonitor | | GET | `/monitors/{monitor_id}/releases` | listMonitorReleases | | POST | `/monitors/{monitor_id}/releases` | upsertMonitorRelease | | PUT | `/monitors/{monitor_id}/releases` | upsertMonitorRelease | | GET | `/monitors/{monitor_id}/releases/default` | getDefaultMonitorVersion | | DELETE | `/monitors/{monitor_id}/releases/{release_name}` | deleteMonitorRelease | | POST | `/monitors/{monitor_id}/releases/{release_name}/promote` | promoteMonitorRelease | | GET | `/monitors/{monitor_id}/runs` | listRunsForMonitor | | GET | `/monitors/{monitor_id}/runs/{run_id}` | getRunScoped | | GET | `/monitors/{monitor_id}/targets` | listMonitorTargets | | POST | `/monitors/{monitor_id}/targets` | createMonitorTarget | | DELETE | `/monitors/{monitor_id}/targets/{monitor_target_id}` | deleteMonitorTarget | | PATCH | `/monitors/{monitor_id}/targets/{monitor_target_id}` | updateMonitorTarget | | PUT | `/monitors/{monitor_id}/targets/{monitor_target_id}` | updateMonitorTarget | | POST | `/monitors/{monitor_id}/targets/{monitor_target_id}/disable` | disableMonitorTarget | | POST | `/monitors/{monitor_id}/targets/{monitor_target_id}/enable` | enableMonitorTarget | | GET | `/monitors/{monitor_id}/targets/{monitor_target_id}/metrics` | getMonitorTargetMetrics | | GET | `/monitors/{monitor_id}/targets/{monitor_target_id}/sparkline` | getMonitorTargetSparkline | | GET | `/monitors/{monitor_id}/versions` | listMonitorVersions | | POST | `/monitors/{monitor_id}/versions` | publishMonitorVersion | | GET | `/monitors/{monitor_id}/versions/{version_id}` | getMonitorVersion | | GET | `/reports/fallbacks` | listFallbacks | | GET | `/reports/faults` | listFaults | | GET | `/reports/intents/{intent_id}/fallbacks` | listFallbacksByIntent | | GET | `/reports/intents/{intent_id}/faults` | listFaultsByIntent | | GET | `/requests` | listRequests | | GET | `/requests/{request_id}` | getRequest | | PUT | `/requests/{request_id}/response` | updateRequestResponse | | POST | `/search` | search | | GET | `/sentinels` | listSentinels | | POST | `/sentinels` | createSentinel | | GET | `/sentinels/applications/{application_id}` | listSentinelsByApplication | | GET | `/sentinels/applications/{application_id}/human-needs` | listSentinelsByApplicationHumanNeeds | | POST | `/sentinels/generate` | generateSentinels | | POST | `/sentinels/generate/new` | generateNewSentinel | | GET | `/sentinels/intent-groups/by-name/{intent_name}` | listSentinelsByIntentName | | GET | `/sentinels/intent-groups/{intent_group_id}` | listSentinelsByIntentGroup | | POST | `/sentinels/regenerate` | regenerateSentinels | | GET | `/sentinels/simple` | listSimpleSentinels | | DELETE | `/sentinels/{sentinel_id}` | deleteSentinel | | GET | `/sentinels/{sentinel_id}` | getSentinel | | PUT | `/sentinels/{sentinel_id}` | updateSentinel | | PUT | `/sentinels/{sentinel_id}/directive` | updateSentinelDirective | | POST | `/sentinels/{sentinel_id}/regenerate` | regenerateSentinel | | POST | `/sentinels/{sentinel_id}/regenerate/correction` | regenerateSentinelCorrection | | POST | `/sentinels/{sentinel_id}/regenerate/evaluation` | regenerateSentinelEvaluation | | POST | `/sentinels/{sentinel_id}/regenerate/qualification` | regenerateSentinelQualification | | GET | `/sessions` | listSessions | | GET | `/sessions/{session_id}` | getSession | | POST | `/sessions/{session_id}/feedback` | setSessionFeedback | | GET | `/sessions/{session_id}/timeline` | getSessionTimeline | | GET | `/test-runs` | listTestRuns | | POST | `/test-runs` | createTestRun | | POST | `/test-runs/compare` | compareTestRuns | | GET | `/test-runs/intent-groups/{intent_group_id}` | listTestRunsByIntentGroup | | GET | `/test-runs/requests/compare/{base_request_id}/{compare_request_id}` | getTestRunRequestComparison | | GET | `/test-runs/test-sets/{test_set_id}` | listTestRunsByTestSet | | GET | `/test-runs/test-sets/{test_set_id}/progress` | getTestRunProgressByTestSet | | DELETE | `/test-runs/{test_run_id}` | deleteTestRun | | GET | `/test-runs/{test_run_id}` | getTestRun | | POST | `/test-runs/{test_run_id}/evaluate` | evaluateTestRun | | GET | `/test-runs/{test_run_id}/items` | listTestRunItems | | PUT | `/test-runs/{test_run_id}/items/{item_id}` | updateTestRunItem | | GET | `/test-runs/{test_run_id}/progress` | getTestRunProgress | | POST | `/test-runs/{test_run_id}/re-evaluate` | reEvaluateTestRun | | GET | `/test-runs/{test_run_id}/requests` | listTestRunRequests | | POST | `/test-runs/{test_run_id}/requests/{offset}/{limit}` | listTestRunRequestsWithFilters | | POST | `/test-runs/{test_run_id}/requests/{test_run_request_id}/evaluate` | evaluateTestRunRequest | | GET | `/test-runs/{test_run_id}/results` | getTestRunResults | | POST | `/test-runs/{test_run_id}/resume` | resumeTestRun | | POST | `/test-runs/{test_run_id}/retry` | retryTestRun | | GET | `/test-runs/{test_run_id}/review-segments` | listTestRunReviewSegments | | PUT | `/test-runs/{test_run_id}/status/{status}` | updateTestRunStatus | | POST | `/test-runs/{test_run_id}/stop` | stopTestRun | | GET | `/test-set-jobs/{job_id}` | getTestSetJob | | GET | `/test-sets` | listTestSets | | POST | `/test-sets` | createTestSet | | GET | `/test-sets/applications/{application_id}/intents/{intent_id}` | listTestSetsByApplicationIntent | | POST | `/test-sets/convert-to-workflow` | convertTestSetToWorkflow | | POST | `/test-sets/convert-workflow-to-requests` | convertWorkflowTestSetToRequests | | GET | `/test-sets/datasets/{dataset_id}` | listTestSetsByDataset | | GET | `/test-sets/datasets/{dataset_id}/source` | listTestSetsCreatedFromDataset | | GET | `/test-sets/eligible-requests/{intent_group_id}/{test_set_id}` | listEligibleTestSetRequests | | POST | `/test-sets/eligible-requests/{intent_group_id}/{test_set_id}/search` | searchEligibleTestSetRequests | | GET | `/test-sets/intent-groups/by-name/{intent_group_name}` | listTestSetsByIntentGroupName | | GET | `/test-sets/intent-groups/{intent_group_id}` | listTestSetsByIntentGroup | | PUT | `/test-sets/request/add` | addSingleRequestToTestSet | | DELETE | `/test-sets/request/remove` | removeSingleRequestFromTestSet | | PUT | `/test-sets/requests/add` | addTestSetRequestsBulk | | PUT | `/test-sets/requests/remove` | removeTestSetRequestsBulk | | DELETE | `/test-sets/{test_set_id}` | deleteTestSet | | GET | `/test-sets/{test_set_id}` | getTestSet | | PUT | `/test-sets/{test_set_id}` | updateTestSet | | POST | `/test-sets/{test_set_id}/clone` | cloneTestSet | | GET | `/test-sets/{test_set_id}/imported-session-ids` | listTestSetImportedSessionIds | | DELETE | `/test-sets/{test_set_id}/items` | removeTestSetItems | | GET | `/test-sets/{test_set_id}/items` | listTestSetItems | | POST | `/test-sets/{test_set_id}/items` | addTestSetItems | | DELETE | `/test-sets/{test_set_id}/items/{item_id}` | deleteTestSetItem | | DELETE | `/test-sets/{test_set_id}/items/{item_id}/response-sub` | deleteTestSetItemResponseSub | | GET | `/test-sets/{test_set_id}/items/{item_id}/response-sub` | getTestSetItemResponseSub | | PUT | `/test-sets/{test_set_id}/items/{item_id}/response-sub` | upsertTestSetItemResponseSub | | GET | `/test-sets/{test_set_id}/prompt-template` | getTestSetPromptTemplate | | GET | `/test-sets/{test_set_id}/request-distribution` | getTestSetRequestDistribution | | DELETE | `/test-sets/{test_set_id}/requests` | removeRequestsFromTestSet | | GET | `/test-sets/{test_set_id}/requests` | listTestSetRequests | | POST | `/test-sets/{test_set_id}/requests` | addRequestsToTestSet | | PUT | `/test-sets/{test_set_id}/requests/{request_id}/response` | updateTestSetRequestResponse | | PUT | `/test-sets/{test_set_id}/requests/{request_id}/tags` | updateTestSetRequestTags | | GET | `/test-sets/{test_set_id}/sessions` | listTestSetSessionFacets | | GET | `/unified-test-runs` | listUnifiedTestRuns | | POST | `/unified-test-runs` | createUnifiedTestRun | | POST | `/unified-test-runs/preview-adapted-input` | previewAdaptedInput | | DELETE | `/unified-test-runs/{test_run_id}` | deleteUnifiedTestRun | | GET | `/unified-test-runs/{test_run_id}` | getUnifiedTestRun | | POST | `/unified-test-runs/{test_run_id}/cancel` | cancelUnifiedTestRun | | POST | `/unified-test-runs/{test_run_id}/execute` | executeUnifiedTestRun | | GET | `/unified-test-runs/{test_run_id}/items` | listUnifiedTestRunItems | | POST | `/unified-test-runs/{test_run_id}/prepare` | prepareUnifiedTestRun | | GET | `/unified-test-runs/{test_run_id}/progress` | getUnifiedTestRunProgress | | POST | `/unified-test-runs/{test_run_id}/reset-failed` | resetFailedUnifiedTestRunItems | | POST | `/unified-test-runs/{test_run_id}/score` | scoreUnifiedTestRun | | GET | `/unified-test-sets` | listUnifiedTestSets | | POST | `/unified-test-sets` | createUnifiedTestSet | | POST | `/unified-test-sets/upload` | uploadUnifiedTestSetJsonl | | GET | `/unified-test-sets/{test_set_id}` | getUnifiedTestSet | | PATCH | `/unified-test-sets/{test_set_id}` | patchUnifiedTestSet | | POST | `/unified-test-sets/{test_set_id}/clone` | cloneUnifiedTestSet | | POST | `/unified-test-sets/{test_set_id}/import-agent-task` | importAgentTaskIntoUnifiedTestSet | | POST | `/unified-test-sets/{test_set_id}/import-request` | importRequestIntoUnifiedTestSet | | POST | `/unified-test-sets/{test_set_id}/import-workflow-run` | importWorkflowRunIntoUnifiedTestSet | | GET | `/unified-test-sets/{test_set_id}/items` | listUnifiedTestSetItems | | POST | `/unified-test-sets/{test_set_id}/items` | createUnifiedManualTestSetItem | | DELETE | `/unified-test-sets/{test_set_id}/items/{item_id}` | deleteUnifiedTestSetItem | | GET | `/unified-test-sets/{test_set_id}/items/{item_id}` | getUnifiedTestSetItem | | PUT | `/unified-test-sets/{test_set_id}/items/{item_id}/expected-output-override` | upsertUnifiedTestSetItemExpectedOutputOverride | | GET | `/workflows` | listWorkflows | | POST | `/workflows` | createWorkflow | | POST | `/workflows/chat/completions` | createWorkflowChatCompletion | | GET | `/workflows/default-script` | getDefaultWorkflowScript | | GET | `/workflows/runs` | listWorkflowRuns | | PUT | `/workflows/runs/log` | logWorkflowRun | | GET | `/workflows/runs/{session_id}` | getWorkflowRun | | POST | `/workflows/upload` | uploadWorkflowBundle | | POST | `/workflows/validate` | validateWorkflowScript | | DELETE | `/workflows/{workflow_id}` | deleteWorkflow | | GET | `/workflows/{workflow_id}` | getWorkflow | | PUT | `/workflows/{workflow_id}` | updateWorkflow | | DELETE | `/workflows/{workflow_id}/accessories` | deleteWorkflowAccessory | | POST | `/workflows/{workflow_id}/accessories` | uploadWorkflowAccessory | | GET | `/workflows/{workflow_id}/artifact-files` | getWorkflowArtifactFiles | | GET | `/workflows/{workflow_id}/datastores` | listWorkflowDatastores | | DELETE | `/workflows/{workflow_id}/datastores/{name}` | deleteWorkflowDatastore | | POST | `/workflows/{workflow_id}/datastores/{name}` | upsertWorkflowDatastore | | POST | `/workflows/{workflow_id}/datastores/{name}/upload` | uploadWorkflowDatastore | | GET | `/workflows/{workflow_id}/has-transforms` | checkWorkflowTransforms | | GET | `/workflows/{workflow_id}/releases` | listWorkflowReleases | | POST | `/workflows/{workflow_id}/releases` | createWorkflowRelease | | POST | `/workflows/{workflow_id}/releases/clear-default` | clearWorkflowDefaultRelease | | DELETE | `/workflows/{workflow_id}/releases/{name}` | deleteWorkflowRelease | | PUT | `/workflows/{workflow_id}/releases/{name}` | updateWorkflowRelease | | GET | `/workflows/{workflow_id}/schema` | getWorkflowSchema | | GET | `/workflows/{workflow_id}/script` | getWorkflowScript | | GET | `/workflows/{workflow_id}/transform-info` | getWorkflowTransformInfo | | POST | `/workflows/{workflow_id}/transform-preview` | previewWorkflowTransform | | GET | `/workflows/{workflow_id}/versions` | listWorkflowVersions | | POST | `/workflows/{workflow_id}/versions` | publishWorkflowVersion | | GET | `/workflows/{workflow_id}/versions/{version_number}/artifact-files` | getWorkflowVersionArtifactFiles |