Skip to main content

Product documentation

Model metadata enhancement

Added context window, input/output costs per 1M tokens, and capabilities to model catalog from models.dev

Status
shipped
Area
policy
Published
Control impact
Enables informed model selection based on context limits and pricing.
  • Context window size per model
  • Input cost per 1M tokens
  • Output cost per 1M tokens
  • Model capabilities (streaming, tools, etc.)