LiteLLM | Operate As Docs

Connect your client's LiteLLM with a key they paste, and call its API through Operate As.

Website: litellm.ai
Connects by: Pasting a Virtual key
Category: AI
Services: 1
Tools: Pass-through only

Service	Key	Base URL
LiteLLM	`litellm`	`https://{site}`

Your client also types their litellm address (Where your LiteLLM is, such as example.com, without https://).

Connecting

Your client makes a Virtual key in their LiteLLM settings and pastes it on their link. Operate As tries it with LiteLLM before saving it, and stores it encrypted. See Services connected with an API key.

Check they're connected

curl https://api.operate.as/v1/me/clients \
  -H "Authorization: Bearer $OPERATE_AS_API_KEY"

curl https://api.operate.as/v1/me/clients \  -H "Authorization: Bearer $OPERATE_AS_API_KEY"

Response

[
  {
    "id": "6f1c2a7e-...",
    "name": "Miller Dental",
    "services": [
      "litellm"
    ]
  }
]

[  {    "id": "6f1c2a7e-...",    "name": "Miller Dental",    "services": [      "litellm"    ]  }]

Permissions

What the client reads	Permission it asks for
Use the LiteLLM key you paste, with only the access you gave that key	Chosen on the provider's screen

Pass-through

LiteLLM has no ready-made tools yet. Call any endpoint of its API through Operate As instead, with the client's access attached.

Add the client

In Clients, add your client and select LiteLLM. Then send them their link.

Your client connects

They paste a Virtual key from their LiteLLM settings.

Find the endpoint

Pick the call from LiteLLM's own API docs. Your path is everything after https://{site}, with the parts in braces filled in from your client's account.

Send it through Operate As

Use the client's ID, the service key litellm and that path. Your Operate As key goes in Authorization; the client's access is added for you.

See Pass-through requests for the full request and response format.

Call any endpoint

curl "https://api.operate.as/v1/clients/6f1c2a7e-.../litellm/..." \
  -H "Authorization: Bearer $OPERATE_AS_API_KEY"

curl "https://api.operate.as/v1/clients/6f1c2a7e-.../litellm/..." \  -H "Authorization: Bearer $OPERATE_AS_API_KEY"

Response

{
  "status": 200,
  "data": {
    "…": "the service's own response"
  },
  "encoding": "json"
}

{  "status": 200,  "data": {    "…": "the service's own response"  },  "encoding": "json"}

When access ends

A key works until your client deletes it in LiteLLM. They can paste a new one on the same link at any time, and your workflows carry on without changes.

See Keeping access alive and Removing access.

Calls answer, once the key is deleted

{
  "status": 401,
  "data": {
    "…": "the service's own error"
  },
  "encoding": "json"
}

{  "status": 401,  "data": {    "…": "the service's own error"  },  "encoding": "json"}