OpenAI SDK

Most OpenAI SDK calls work with rout.my by changing the base URL and API key.

Python

from openai import OpenAI
import os

client = OpenAI(
    base_url="https://api.rout.my/v1",
    api_key=os.environ["ROUTMY_API_KEY"],
)

response = client.chat.completions.create(
    model="provider/model-id",
    messages=[{"role": "user", "content": "Hello!"}],
)

print(response.choices[0].message.content)

Node.js

import OpenAI from 'openai';

const client = new OpenAI({
  baseURL: 'https://api.rout.my/v1',
  apiKey: process.env.ROUTMY_API_KEY
});

const response = await client.chat.completions.create({
  model: 'provider/model-id',
  messages: [{ role: 'user', content: 'Hello!' }]
});

console.log(response.choices[0].message.content);

Models

const models = await client.models.list();
console.log(models.data.map((model) => model.id));

Copy an exact model ID from the list into chat, embeddings, image, or video requests.

Embeddings

const embedding = await client.embeddings.create({
  model: 'provider/embedding-model-id',
  input: 'Text to embed'
});

console.log(embedding.data[0].embedding.length);