Changelog

All notable changes to LLMOps are documented here.

v0.6.10

Bug Fixes

  • •Add OpenRouter fallback for models with slash in name (#69)

Other Changes

  • •Add tooltip showing full-cost precision on hover (#68)

v0.6.9

Other Changes

  • •Fix SDK initialization errors with missing tables and better-auth 1.5.x (#66)

v0.6.8

New Features

  • •add timestamp to health endpoint responses (#61)

Bug Fixes

  • •allow empty config in validateLLMOpsConfig (#65)

Other Changes

  • •[SDLC Agent] Edge runtime Readiness (#64)

v0.6.7

New Features

  • •fix tag breakdown double-counting in cost distribution (#56)
  • •add LangChain integration, docs and example (#54)

v0.6.6

New Features

  • •implement OpenRouter embeddings API support (#52)

v0.6.5

New Features

  • •implement OpenRouter Responses API support (#51)

Other Changes

  • •Add OTLP protobuf decoder and protobufjs dep (#50)

v0.6.4

Maintenance release.

v0.6.3

Other Changes

  • •Enable cost calculation for SDK/OTLP traces (#49)

v0.6.2

Other Changes

  • •Cache Token Analytics & Cache-Aware Pricing (#47)

v0.6.1

Other Changes

  • •Fix duplicate traces when using agents exporter with SDK (#48)

v0.6.0

New Features

  • •add distributed tracing with OTLP support (#45)

Other Changes

  • •Website redesign (#39)

v0.5.4

Other Changes

  • •Fix cost legend layout to display items vertically (#44)

v0.5.3

Other Changes

  • •Add conductor.json with setup and run scripts (#43)
  • •Add cost breakdown grouping options (model, endpoint, tags) (#40)

v0.5.2

New Features

  • •make llmops config entirely optional with defaults (#42)

v0.5.1

New Features

  • •add inline gateway client interface via provider() (#41)

v0.5.0

New Features

  • •inline provider configuration with auto-detection (#38)

Other Changes

  • •Add Next.js integration to SDK (#35)

v0.4.7

Other Changes

  • •add embedding params to the gateway adapter

v0.4.6

Other Changes

  • •Set default cookie prefix for auth client

v0.4.5

Other Changes

  • •Embed generated client assets and manifest

v0.4.4

Other Changes

  • •Add endpoint column to observability requests table (#34)

v0.4.3

Other Changes

  • •Add createModelResponse support for Azure AI Inference provider (#33)

v0.4.2

Other Changes

  • •Fix playground execute for reverse proxy deployments (#32)
  • •Add generated embedded assets and manifest
  • •Fix basePath handling for playground execute endpoints
  • •Fix curl builder link overflow
  • •Add Docs link and restyle GitHub button

v0.4.1

Other Changes

  • •Exclude stream_options from Responses config
  • •Use flat spread for DataLayer to maintain backwards compatibility
  • •Refactor datalayer exports; re-export schema types
  • •Add DataLayer interface and factory function

v0.4.0

New Features

  • •add Playgrounds feature to sidebar and routing

Other Changes

  • •Support Responses API in gateway adapter
  • •Reset embedded assets and add css calc import
  • •Use input_variables for template rendering
  • •Format DB schema types and reorder SCHEMA_METADATA
  • •Update generated embedded assets
  • •Remove horizontal padding from prompt footer
  • •Add Responses API token handling and reset assets
  • •Add generated embedded assets
  • •Add SavePromptPopup and integrate into column
  • •Add SaveVariantPopup and enable source tracking
  • •Add toast UI and playground-from-config hook
  • •Add Evaluate in menu to variant header
  • •Reset margins for dataset empty state text
  • •Add playground-from-config endpoint
  • •Update playgrounds.tsx to fix data fetching on selected row change
  • •Use xs border radius for UI components
  • •Add playground row detail view and navigation
  • •Add playground execution hook with SSE
  • •Add DatasetResultsSection component and styles
  • •Extract dataset results section component
  • •Add DatasetSelector combobox and styles
  • •Add dataset selector and bottom panel
  • •Add drag-and-drop for playground columns
  • •Add PromptColumn UI with autosave and schema fix
  • •Add toolbar to playground page
  • •Remove playground UI components for user to implement
  • •Add multi-column playground UI components
  • •Add multi-column playground schema, API handlers, and client hooks
  • •Add dataset records UI with CodeMirror editor
  • •Add MVP Datasets feature with schema, data layer, API, and client hooks
  • •Add Playgrounds API, data layer, and UI

v0.3.3

Other Changes

  • •Add guardrail types and observability

v0.3.2

Bug Fixes

  • •make guardrails available in production builds

Other Changes

  • •Use import assertions for JSON imports
  • •Add dialogDescription style and use it
  • •design: redesign costs page with minimal typography layout
  • •Adjust overview spacing and reorder stats
  • •Load guardrails into manifest and use in gateway
  • •Use logger instead of console in gatewayAdapter
  • •Integrate guardrails from database into gateway requests
  • •Fix table header and row alignment in guardrails UI
  • •Fix guardrails UI toggle switch and badge styles
  • •Add Collapsible and MessageBlock components
  • •Add guardrails management UI and API

v0.3.1

Other Changes

  • •Add Collapsible and MessageBlock components
  • •Set fetch-depth to 0 for docs deploy workflow

v0.3.0

New Features

  • •Add changelog page with auto-generated releases

Other Changes

  • •Use design tokens for insight colors
  • •Include Bootstrap basePath in curl builder URL
  • •Add Gateway handbook page and update docs routes
  • •Adjust overview styles and update hero text
  • •Add fade-in animation to model selector popups
  • •Improve overview page and onboarding flow
  • •Type onMouseEnter handlers in ModelSelector
  • •Rename API Usage page title and update icon
  • •Enhance Gateway curl builder and inline select UI
  • •Normalize quotes and add /github redirect
  • •Always show environment and API key selects
  • •Add interactive curl builder for Gateway usage
  • •Add Gateway routes and move Providers UI
  • •Add manifest routing service and credentials cache
  • •fix readme railway link
  • •Add Gateway sidebar item and guard headers

v0.2.14

Other Changes

  • •Add Connect Provider link to model selector
  • •Replace Combobox list with menu items
  • •Refocus model search input on empty state change
  • •Control ModelSelector; add provider and modelName
  • •Add model params UI and extend model metadata
  • •Add providers menubar and params popover
  • •Add search filtering and styling to model selector
  • •Add model selector with grouped models API and hook
  • •Add slug support for provider configs
  • •Embed generated assets and add adaptive favicon

v0.2.13

Other Changes

  • •Add favicon, reset embedded assets, fix typo

v0.2.12

Other Changes

  • •Add generated embedded assets and tweaks
  • •Add Neon support and schema-qualified tables
  • •Add Neon serverless support and PostgREST

v0.2.11

Other Changes

  • •Rename Configs to Prompts and add header alias
  • •Add provider config ID support and resolution
  • •Support optional provider config name

v0.2.10

Other Changes

  • •Include metadata only when store is enabled
  • •Add Observability handbook page and meta entry
  • •Add Nunjucks/Jinja2 support and generated assets

v0.2.9

Other Changes

  • •Return new Response with updated headers

v0.2.8

Other Changes

  • •Support Azure Foundry and deployment IDs
  • •Add browser-safe provider mapping and logging
  • •Add provider ID mapping and logging
  • •Detect beta tag in CI and add embedded assets
  • •Add provider ID mapping and Azure support

v0.2.7

Other Changes

  • •Add Nunjucks template support and editor plugin
  • •Add standalone Docker deployment docs

v0.2.6

Other Changes

  • •Add generated embedded assets
  • •Replace Discord link with Railway deploy button
  • •Add Deploy Standalone LLMOps header

v0.2.5

Other Changes

  • •Clarify onboarding copy about configs
  • •Refactor onboarding flow to use react-hook-form
  • •Add Discord support link, icon, and redirect route

v0.2.4

Other Changes

  • •Use environment API key when copying curl command
  • •Add deployment success dialog
  • •Update onboarding title for no providers
  • •Reset embedded assets for dev and add onboarding flow

v0.2.3

Other Changes

  • •Allow dynamic trusted origins for auth client

v0.2.2

Other Changes

  • •Initialize auth client only for API routes

v0.2.1

New Features

  • •Add standalone dockerized LLMOps application

Other Changes

  • •Bump Node base image to 24-alpine
  • •Embed static assets and support single-file build
  • •Add logging and options to MemoryCacheBackend
  • •Add cache service for config/provider data

v0.2.0

Other Changes

  • •Invert provider logos in dark mode
  • •Move provider configuration to dashboard
  • •Remove provider configs and fetch keys from DB
  • •Add provider configs CRUD and UI
  • •Bump dev dependencies and update lockfile and docs
  • •Remove default auth credentials from docs example
  • •Remove basicAuth docs and add forwardHeaders

v0.1.9

Other Changes

  • •Set auth basePath and update sign-in navigation
  • •Use promise chaining for sign-up flow
  • •Use useNavigate to reload document after setup
  • •Wire Better Auth hooks and add form validation
  • •Remove basic auth implementation
  • •Add Input component and update auth UI
  • •Add single-user mode with super admin gating
  • •Redesign auth pages with split layout and styles
  • •Add user menu with theme switcher in sidebar
  • •Add app wrapper route and session auth
  • •Remove client-side auth redirects and loading
  • •Provide Kysely DB and type to auth middleware
  • •Add auth setup and signin pages and API
  • •Integrate better-auth and remove autoMigrate option
  • •Integrate better-auth migrations and rawConnection

v0.1.8

Other Changes

  • •Remove debug console.log statements

v0.1.7

Other Changes

  • •Add keywords to sdk package.json

v0.1.6

Other Changes

  • •Enhance packages/sdk README
  • •Document prompt management in README
  • •Add contributing guide and update README
  • •Add project description and badges to README
  • •Support multi-value tag filters across analytics
  • •Add observability filters and analytics params
  • •Forward parent search in Observability sidebar
  • •Track environmentId and tags in cost tracking
  • •Add grouped cost summary with token totals
  • •Add Recharts charts to observability overview
  • •Remove comingSoon flag for Cost Tracking

v0.1.5

Other Changes

  • •Include app basePath in API base URL
  • •Remove cost breakdown and daily costs charts
  • •Add paginated LLM requests and UI updates
  • •Extract CSS and refactor observability components
  • •Add observability date range picker and validation
  • •Add observability UI and analytics backend
  • •‼️Vibe Coded: Add LLM cost tracking and analytics endpoints
  • •Export cache module from core package

v0.1.4

Other Changes

  • •Replace <br> spacer with styled section title
  • •Expose auth type to client and adapt profile UI
  • •Add workspace settings API and UI
  • •Add Settings routes, sidebar and UI
  • •Fix hero prompt link and adjust layout
  • •Add LLMOps runbook and update hero prompt
  • •Serve /llms.txt in dev instead of redirect
  • •Add llms.txt API routes and redirect
  • •Add llms.txt support and /api/llms-txt route
  • •Add PostHog analytics to docs site
  • •Bundle raw MDX and use virtual module in API
  • •Add Copy Markdown button and /api/mdx route
  • •Add Express and Hono integration docs

v0.1.3

Other Changes

  • •Adjust editor placeholder spacing and line-height
  • •Clarify LLMOps header and request guard comments
  • •Use Authorization Bearer for environment secret
  • •Migrate tests from Jest to Vitest

v0.1.2

Other Changes

  • •Set configId and envSec in CORS branch
  • •Remove enterprise-specific auth comments
  • •Add authHandled flag and enterprise docs
  • •Use basicAuth helper in docs examples
  • •Add extensible auth module and basicAuth client
  • •Add workspace_settings table and minor fixes
  • •Add Base URL label and spacing

v0.1.1

Other Changes

  • •Annotate Vite config with UserConfig type
  • •Add copyable API base URL to overview
  • •Remove Logo from empty configs state
  • •Add EmptyConfigsState component and styles
  • •Show empty state when no configs
  • •Add favicon and copy public assets into build
  • •Add configurable PostgreSQL schema support
  • •Add handbook: configs, environments, variants
  • •Add configuration and providers docs

v0.1.0

Other Changes

  • •Format Quickstart iframe and fix props
  • •Remove Supported Providers and update architecture
  • •Add auto-migration support and middleware
  • •Restructure docs and add Quickstart
  • •Add integer and boolean type mappings for Postgres
  • •Add CommonJS build and require-based env loading
  • •Add CommonJS output and conditional exports
  • •Add CJS build and conditional exports to SDK
  • •Normalize pnpm-lock workspace specifiers
  • •Use caret for workspace dependencies
  • •Import dotenv in Express example
  • •Rename package bin from @llmops/cli to cli
  • •Enable public publishing and configure CLI
  • •Set NPM auth and provenance in workflow
  • •Remove npm publish env vars
  • •Update build_and_deploy.yml
  • •Add README headers for CLI and SDK packages
  • •Add metadata and Apache-2.0 license to packages
  • •Embed UI package into app and update imports
  • •Run workspace builds serially
  • •Allow prerelease tags without hyphen in workflow
  • •Add Build and Deploy GitHub Actions workflow
  • •Add Hono middleware and example
  • •Remove Providers tab and add AI Gateway card
  • •Change docs dev server port and remove debug log
  • •Update deps, add CLI types, rename env param
  • •All 10 PRs from Portkey-AI/gateway (Dec 22-24, 2025) have been synced: | PR | Description | Status | |-----|-------------|--------| | #1477 | Anthropic tool_choice=none | Already in codebase | | #1415 | Ollama thinking parameter | Completed (previous session) | | #1486 | Gemini reasoning effort fix | Completed (previous session) | | #1488 | Azure OpenAI batches URL fix | Completed (previous session) | | #1480 | Azure Shield Prompt/Protected Material plugins | Completed | | #1475 | Sequential guardrails execution | Completed | | #1478 | Google Maps grounding support | Completed | | #1479 | Transform type fixes | Completed | | #1481 | Not Null guardrail plugin | Completed | | #1471 | OVHcloud AI Endpoints provider | Completed |
  • •Add typed provider configs and update schema
  • •Use SupportedProviders to build providers schema
  • •Move providers to gateway and add models.dev endpoints
  • •Add Recent Configs Table to Overview
  • •Display variant versions and fix subroute header
  • •Move variant name to header and add version selector
  • •Add many LLM providers and OpenAI support
  • •Add Join Discord button to home hero
  • •Update docs site layout and config
  • •Add favicon link to root route
  • •Add favicon for docs site
  • •Center and size logo SVG
  • •Invert footer logo in dark mode and add route
  • •Load Cloudflare plugin only in production
  • •Ignore .wrangler and update compatibility date
  • •Remove prerender option from tanstackStart
  • •Bump wrangler to 4.56.0 and update lockfile
  • •Bump Wrangler to 4.54.0 in docs
  • •Remove pnpm version pin from deploy docs
  • •Add workflow to deploy docs to Cloudflare Workers
  • •Update copyright to ByteByByte Ventures LLP
  • •Add feature tabs, cards, animated logo and footer
  • •Add animated hero with GitHub stars and copy
  • •Show and copy config slug in header
  • •Support short slugs for config IDs
  • •Use useConfigById hook in ConfigsHeader
  • •Require explicit variant versions and update API
  • •Add variant version support and use latest by default
  • •Add Product Handbook and homepage Features
  • •Add Quickstart guide and fix middleware import
  • •Add homepage hero, code editor, logo, and styles
  • •Add docs site with Fumadocs and routing
  • •Update README.md
  • •Update README.md
  • •Replace README with centered header and add images
  • •Conditionally render ReactRefresh in dev
  • •Remove settings route and clean up deps
  • •Support SSE streaming in Express middleware
  • •Add bumpp release config and bump package versions
  • •Fix gateway adapter
  • •Add gateway adapter
  • •Remove gateway package .github files
  • •add gateway package
  • •Prevent deleting production environments
  • •Redesign secrets list with visibility and copy
  • •Extract tab styles to shared styles file
  • •Add environment settings UI with delete flow
  • •Add environment tabs and nested routes
  • •Add secrets support for environments
  • •Use environment param in navigate call
  • •Add Environments UI, routes and hooks
  • •Center new config state and add title
  • •Add Swagger UI, request guard, and variant configs
  • •Display new config state and add dark-mode logo
  • •Add Tooltip component and use in sidebar
  • •Add Settings link to sidebar and routes
  • •Add app overview route and styles
  • •Use lucide icons for table sort indicators
  • •Add config deletion UI, hook, and server handler
  • •Display provider icons in model settings
  • •Refactor targeting form and simplify variant display
  • •Add positionMethod prop to Popover
  • •Refactor model settings popover UI
  • •Add @base-ui/react and nested model menu
  • •Add environment targeting UI and combobox variants
  • •Make targeting conditions non-null
  • •Add dark theme, custom scrollbars, and prefetch
  • •Add query options, router context, and config endpoint
  • •Add environments and targeting APIs and UI
  • •Add targeting rules feature
  • •Add Model Settings popover and UI primitives
  • •Rename variant name to variant_name
  • •Add environment and secret datalayers with seed
  • •Bind system_prompt to Markdown editor
  • •Add Markdown editor to variant form
  • •Handle variant name and block unsaved navigation
  • •Add inline combobox layout and action buttons
  • •Remove unused import getConfigVariantsQueryKey
  • •Add variants API and enable variant edit UI
  • •Include variant name and simplify variants table
  • •Add provider models and link variants to configs
  • •Render provider icons in Combobox
  • •Improve configs UI and combobox disabled state
  • •Add inline combobox and style variant form
  • •Add Combobox component and global theme
  • •Remove buttonRecipe export from components index
  • •Refactor configs routes and add variant support
  • •Introduce _tabs route for config pages
  • •Add variants and config-variant management
  • •Add Tabs component and integrate into configs view
  • •Use JSON for configs, honor basePath, fix DB URL
  • •Switch to dark theme and improve config inputs
  • •Integrate React Query and add configs CRUD
  • •Add configs API and UI scaffolding
  • •Add table component and react-table support
  • •Add nested configs routes, outlet and overflow fix
  • •Revamp Button component and Storybook theming
  • •Add config data layer and zod schema validation
  • •Replace Kysely adapter with db module
  • •Add Zod-based DB schema and Kysely adapters
  • •Rename BetterAuth types to LLMOps; adjust imports
  • •Move Kysely adapter into core and add PG support
  • •Add Kysely adapter and migration/generator CLI
  • •Introduce DB adapter factory and SDK client
  • •Add database config; update easing and types
  • •Add environment_secrets and fix schema
  • •Add twin-split layout with animated tile width
  • •Add Overview sidebar item and route metadata
  • •Extract AppSidebar and replace inline sidebar
  • •Add Breadcrumbs component and route icons
  • •Use node env and include Vite entry CSS
  • •Use Jotai atom for sidebar collapse state
  • •Animate sidebar width and add motion dependency
  • •Add Drizzle ORM schema and DB deps
  • •Add Configs route and show title in header
  • •Add UI layout and server env validation
  • •Refactor sidebar and styles; add layout route
  • •Use CSS class and clsx instead of stylex
  • •Migrate styles from stylex to vanilla-extract
  • •Integrate TanStack Router and layout components
  • •Validate LLMOps config at startup
  • •Add OpenRouter provider and OpenAI integration
  • •Add GenAI API handlers and request validation
  • •Add Page component and global styles
  • •Add app and ui packages and middleware
  • •Add Express example and basic SDK middleware
  • •Remove CLI package and add examples, parallel dev
  • •Add initial README for LLMOps TypeScript workspace
  • •Include JS in ESLint and add globals support
  • •init