AI Inference
AI Inference
An OpenAI compatible inference API
AI Inference answers the same requests as the OpenAI API, so most applications need a base URL and a key changed and nothing else.
Start with the quickstart, which gets a request answered in a few minutes. The API reference covers every endpoint, and error handling covers what comes back when a request cannot be served.
Moving an existing application over is covered in migration from OpenAI.