Queue

Get queue metrics

Get the current queue statistics for a model, including pending and running job counts.

Authorization

bearerAuth

AuthorizationBearer <token>

In: header

model*string

Model name to get metrics for

curl -X GET "https://example.com/queue/metrics?model=string"

{  "messages_running": 0,  "messages_waiting": 0,  "total_jobs": 0}

Clear a model's pending jobs POST

Cancel all pending jobs for the given model. Running jobs are left untouched. Returns the number of jobs that were canceled.

Get job status GET

Poll the current status of a previously submitted job. Provide the request_id and model as query parameters.