Release

Model routing: the right model for each request

Send every request to one endpoint and let Prism.si pick the model.

Routing rules decide which model answers each request, based on cost, speed or the kind of task.

You can set a default, add fallbacks for outages and try a new model on a small share of traffic before switching.

Routing works with every provider you have connected, plus your own hosted models.

Create a free website with Framer, the website builder loved by startups, designers and agencies.