Update a deployment

Args overrides the container's CMD. Provide as an array of arguments (e.g., ["python", "app.py"])

Autoscaling configuration for the deployment. Set to {} to disable autoscaling

Controls how replicas above reserved capacity behave. stable replicas stay running after scale-up; preemptible replicas may be evicted during capacity contention.

Command overrides the container's ENTRYPOINT. Provide as an array (e.g., ["/bin/sh", "-c"])

CPU is the number of CPU cores to allocate per container instance (e.g., 0.1 = 100 milli cores)

Description is an optional human-readable description of your deployment

EnvironmentVariables is a list of environment variables to set in the container. Replaces all existing environment variables.

GPUCount is the number of GPUs to allocate per container instance

GPUType specifies the GPU hardware to use (e.g., "h100-80gb")

HealthCheckPath is the HTTP path for health checks (e.g., "/health"). Set to empty string to disable health checks

Image is the container image to deploy from registry.together.ai.

MaxReplicas is the maximum number of replicas that can be scaled up to.

Memory is the amount of RAM to allocate per container instance in GiB (e.g., 0.5 = 512MiB)

MinReplicas is the minimum number of replicas to run

Replacement model weights to mount into the deployment. At most one mount is supported, and it cannot be used with volumes.

Name is the new unique identifier for your deployment. Must contain only alphanumeric characters, underscores, or hyphens (1-100 characters)

Port is the container port your application listens on (e.g., 8080 for web servers)

Storage is the amount of ephemeral disk storage to allocate per container instance (e.g., 10 = 10GiB)

TerminationGracePeriodSeconds is the time in seconds to wait for graceful shutdown before forcefully terminating the replica

Volumes is a list of volume mounts to attach to the container. Replaces all existing volumes.