Skip to content

Read AI model latency

What you can call today

Every example here runs against api.xovris.ai with a key from your account’s settings. GET /v1/health and GET /v1/public/status answer without one.

GET
/v1/metrics/inference
curl --request GET \  --url https://api.xovris.ai/v1/metrics/inference \  --header 'Authorization: Bearer <token>'

A token that can read is enough.

Done.

Media typeapplication/json
object
empty
required
One of:
string
window
required
object
since
required
string
until
required
string
models
required
Array<object>
object
key
required
string
model
required
string
provider
required
One of:
string
engine
required
string
measuredBy
required
string
Allowed values: server client
requests
required
number
errors
required
One of:
number
p50Ms
required
One of:
number
p95Ms
required
One of:
number
p99Ms
required
One of:
number
meanMs
required
One of:
number
ttftP95Ms
required
One of:
number
tpotP95Ms
required
One of:
number
where
required
Array<string>
mixedBounds
required
boolean
sentence
required
string
unmeasured
required
Array<string>

Example

{  "empty": "string",  "window": {    "since": "string",    "until": "string"  },  "models": [    {      "key": "string",      "model": "string",      "provider": "string",      "engine": "string",      "measuredBy": "server",      "requests": 1,      "errors": 1,      "p50Ms": 1,      "p95Ms": 1,      "p99Ms": 1,      "meanMs": 1,      "ttftP95Ms": 1,      "tpotP95Ms": 1,      "where": [        "string"      ],      "mixedBounds": true,      "sentence": "string"    }  ],  "unmeasured": [    "string"  ]}

Not signed in: the token is missing, expired or revoked. The answer says how to get a new one.

Media typeapplication/json
object
error
required
object
code
required

A stable code a program can branch on.

string
message
required

What happened, in plain words.

string
nextStep
required

What to do next.

string
decisionId

The recorded authorisation decision, when a role refused it.

string

Example generated

{  "error": {    "code": "example",    "message": "example",    "nextStep": "example",    "decisionId": "example"  }}

Signed in, but this token or role may not do this. The answer names the permission it needs.

Media typeapplication/json
object
error
required
object
code
required

A stable code a program can branch on.

string
message
required

What happened, in plain words.

string
nextStep
required

What to do next.

string
decisionId

The recorded authorisation decision, when a role refused it.

string

Example generated

{  "error": {    "code": "example",    "message": "example",    "nextStep": "example",    "decisionId": "example"  }}

Nothing with that id here, or it belongs to another workspace. Nothing was changed.

Media typeapplication/json
object
error
required
object
code
required

A stable code a program can branch on.

string
message
required

What happened, in plain words.

string
nextStep
required

What to do next.

string
decisionId

The recorded authorisation decision, when a role refused it.

string

Example generated

{  "error": {    "code": "example",    "message": "example",    "nextStep": "example",    "decisionId": "example"  }}

Any other refusal or failure. The answer says what happened and what to do next.

Media typeapplication/json
object
error
required
object
code
required

A stable code a program can branch on.

string
message
required

What happened, in plain words.

string
nextStep
required

What to do next.

string
decisionId

The recorded authorisation decision, when a role refused it.

string

Example generated

{  "error": {    "code": "example",    "message": "example",    "nextStep": "example",    "decisionId": "example"  }}

Ask Xovris

Open the full page

Your data is never used to train our AI. How your data is kept

A problem is called fixed only once it works again. How each fix is checked

XOVRIS LTD, registered in England and Wales, company number 17499910. Registered office: 66 Paul Street, London EC2A 4NA.