inference bureau
Create an accountSign up
amazonNot yet certifiedReleased 04/30/2024

Titan Text Embeddings V2

Amazon Titan Text Embeddings V2 is a light weight, efficient multilingual embedding model supporting 1024, 512, and 256 dimensions.

View API reference ↓
Input / output priceFrom$0.020 / $0per 1M
24h uptime100.00%
Get API keyRead the docs

Listed for reference. Inference Bureau dispatches only to certified routes, so requests for this model are refused until one is certified. See certified models.

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "amazon/titan-embed-text-v2",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Providers

Dispatch routes requests across these providers and fails over between them without changing the model. Restrict or order providers with team Directives. Prices are gateway list prices before the platform fee.

ProviderContextMax outputLatencyThroughputInputOutputCacheCapabilitiesZDRNo trainingRegionsStatus
Amazon Bedrock00——$0.020$0Read —Write ——YesYesGlobalListed

Uptime

24 hours

Request success rate per provider.

Amazon Bedrock100.00%

Getting started

Create a key on the API Keys page and set it as IB_API_KEY. See the quickstart.

import OpenAI from "openai";

const client = new OpenAI({
  baseURL: "https://api.inferencebureau.com/v1",
  apiKey: process.env.IB_API_KEY,
});

const res = await client.chat.completions.create({
  model: "amazon/titan-embed-text-v2",
  messages: [{ role: "user", content: "Why is the sky blue?" }],
});

console.log(res.choices[0].message.content);

Top-level parameters

Standard Chat Completions parameters work as documented. These have model-specific behavior.

ParameterTypeRequiredDescription
modelstringYesModel ID in the form creator/model, e.g. amazon/titan-embed-text-v2. Must be allowed by your team's Directives.
max_tokensnumberNoHard cap on generated tokens, and the basis for the balance reserved per request. Titan Text Embeddings V2 supports up to — output tokens.
Supportedmax_tokenstemperaturestop

Input limits

InputSourcesLimits
Text—Prompt and response share the 0-token context window