Together AI API
Together AI DocsGet an API key
HomeAPI ReferenceSDKsContext Plugin
Deployment Service

Get a deployment

GET
/projects/{projectId}/endpoints/{endpointId}/deployments/{id}

Retrieves a deployment's desired configuration, placement, runtime information, and current provisioning status.

Authorization

bearerAuth
AuthorizationBearer <token>

In: header

Path Parameters

projectId*string

Project identifier.

endpointId*string

Endpoint identifier.

id*string

Deployment identifier.

Response Body

application/json

application/json

curl -X GET "https://example.com/projects/string/endpoints/string/deployments/string"
{  "id": "string",  "projectId": "string",  "endpointId": "string",  "name": "string",  "createdAt": "2019-08-24T14:15:22Z",  "updatedAt": "2019-08-24T14:15:22Z",  "modelId": "string",  "modelRevisionId": "string",  "model": "string",  "autoscaling": {    "minReplicas": 0,    "maxReplicas": 0,    "scaleDownWindow": "string",    "scaleUpWindow": "string",    "scaleToZeroWindow": "string",    "scalingMetrics": [      {        "name": "active_sessions",        "type": "METRIC_TARGET_TYPE_VALUE",        "target": 0,        "percentile": "string"      }    ],    "scaleUp": {      "policies": [        {          "type": "SCALING_POLICY_TYPE_PODS",          "value": 1,          "periodSeconds": 1        }      ],      "selectPolicy": "SCALING_POLICY_SELECT_MAX"    },    "scaleDown": {      "policies": [        {          "type": "SCALING_POLICY_TYPE_PODS",          "value": 1,          "periodSeconds": 1        }      ],      "selectPolicy": "SCALING_POLICY_SELECT_MAX"    }  },  "configId": "string",  "config": "string",  "speculatorId": "string",  "speculatorRevisionId": "string",  "speculator": "string",  "estimatedEffectiveTrafficShare": 0.1,  "maxConcurrentRequestsPerReplica": "string",  "inactiveTimeout": 0,  "etag": "string",  "hardware": "string",  "trafficMode": "TRAFFIC_MODE_LIVE",  "runtimeInfo": {    "engineType": "string",    "engineVersion": "string",    "functionCallingSupported": true,    "structuredOutputSupported": true  },  "desiredReplicas": 0,  "status": {    "state": "DEPLOYMENT_STATE_PROVISIONING",    "readyReplicas": 0,    "message": "string",    "scheduledReplicas": 0,    "details": {      "region": [        {          "region": "string",          "scheduledReplicas": 0,          "readyReplicas": 0        }      ]    }  },  "placement": {    "inline": {      "regions": [        "string"      ],      "constraint": "ENFORCEMENT_REQUIRED",      "compliancePolicy": {        "hipaa": true      }    }  }}

Create a deployment POST

Creates a model deployment under an endpoint. The deployment provisions asynchronously; monitor its status before routing live traffic to it.

Update a deployment PATCH

Updates mutable deployment fields such as its model, configuration, autoscaling bounds, or LoRA support. Changes that affect serving may trigger asynchronous reprovisioning.