Together AI

Access 32 Together AI models through Mastra's model router. Authentication is handled automatically using the TOGETHER_API_KEY environment variable.

Learn more in the Together AI documentation.

.env

TOGETHER_API_KEY=your-api-key

src/mastra/agents/my-agent.ts

import { Agent } from "@mastra/core/agent";

const agent = new Agent({
  id: "my-agent",
  name: "My Agent",
  instructions: "You are a helpful assistant",
  model: "togetherai/LiquidAI/LFM2-24B-A2B"
});

// Generate a response
const response = await agent.generate("Hello!");

// Stream a response
const stream = await agent.stream("Tell me a story");
for await (const chunk of stream) {
  console.log(chunk);
}

Models

21 available models

Model	Context	Tools	Reasoning	Image	Audio	Video	Input $/1M	Output $/1M
togetherai/deepseek-ai/DeepSeek-V4-Flash-0731	1.0M						$0.14	$0.28
togetherai/deepseek-ai/DeepSeek-V4-Pro-0813	1.0M						$1	$4
togetherai/deepseek-ai/DeepSeek-V4.1-Flash	1.0M						$0.30	$1
togetherai/LiquidAI/LFM2-24B-A2B	33K						$0.03	$0.12
togetherai/meta-llama/Llama-3.3-70B-Instruct-Turbo	131K						$1	$1
togetherai/meta-models/Muse-Spark-Open-816B-A42B	1.0M						$1	$4
togetherai/MiniMaxAI/MiniMax-M2.7	197K						$0.30	$1
togetherai/MiniMaxAI/MiniMax-M3	524K						$0.30	$1
togetherai/moonshotai/Kimi-K3	1.0M						$3	$15
togetherai/nvidia/nemotron-3-ultra-550b-a55b	512K						$0.60	$4
togetherai/nvidia/NVIDIA-Nemotron-3.5-Super-VL	262K						$0.15	$0.50
togetherai/openai/gpt-oss-120b	131K						$0.15	$0.60
togetherai/Qwen/Qwen2.5-7B-Instruct-Turbo	33K						$0.30	$0.30
togetherai/Qwen/Qwen3.5-9B	262K						$0.17	$0.25
togetherai/Qwen/Qwen3.6-Plus	1.0M						$0.50	$3
togetherai/Qwen/Qwen3.7-Max	1.0M						$1	$4
togetherai/reflection/Beam-1.0-501B-A23B	1.0M						$0.40	$1
togetherai/thinkingmachines/Inkling	524K						$1	$4
togetherai/zai-org/GLM-5.2	1.0M						$1	$4
togetherai/zai-org/GLM-5.3	1.0M						$1	$4
togetherai/zai-org/GLM-5.3-Flash	1.0M						$0.15	$0.50

Model availability, capabilities, context windows, and pricing are sourced from models.dev and may change.

Advanced configuration

Custom headers

src/mastra/agents/my-agent.ts

const agent = new Agent({
  id: "custom-agent",
  name: "custom-agent",
  model: {
    id: "togetherai/LiquidAI/LFM2-24B-A2B",
    apiKey: process.env.TOGETHER_API_KEY,
    headers: {
      "X-Custom-Header": "value"
    }
  }
});

Dynamic model selection

src/mastra/agents/my-agent.ts

const agent = new Agent({
  id: "dynamic-agent",
  name: "Dynamic Agent",
  model: ({ requestContext }) => {
    const useAdvanced = requestContext.task === "complex";
    return useAdvanced
      ? "togetherai/zai-org/GLM-5.3-Flash"
      : "togetherai/LiquidAI/LFM2-24B-A2B";
  }
});