Changelog

All notable changes to LLMOps are documented here.

v0.5.4

Other Changes

  • Fix cost legend layout to display items vertically (#44)

v0.5.3

Other Changes

  • Add conductor.json with setup and run scripts (#43)
  • Add cost breakdown grouping options (model, endpoint, tags) (#40)

v0.5.2

New Features

  • make llmops config entirely optional with defaults (#42)

v0.5.1

New Features

  • add inline gateway client interface via provider() (#41)

v0.5.0

New Features

  • inline provider configuration with auto-detection (#38)

Other Changes

  • Add Next.js integration to SDK (#35)

v0.4.7

Other Changes

  • add embedding params to the gateway adapter

v0.4.6

Other Changes

  • Set default cookie prefix for auth client

v0.4.5

Other Changes

  • Embed generated client assets and manifest

v0.4.4

Other Changes

  • Add endpoint column to observability requests table (#34)

v0.4.3

Other Changes

  • Add createModelResponse support for Azure AI Inference provider (#33)

v0.4.2

Other Changes

  • Fix playground execute for reverse proxy deployments (#32)
  • Add generated embedded assets and manifest
  • Fix basePath handling for playground execute endpoints
  • Fix curl builder link overflow
  • Add Docs link and restyle GitHub button

v0.4.1

Other Changes

  • Exclude stream_options from Responses config
  • Use flat spread for DataLayer to maintain backwards compatibility
  • Refactor datalayer exports; re-export schema types
  • Add DataLayer interface and factory function

v0.4.0

New Features

  • add Playgrounds feature to sidebar and routing

Other Changes

  • Support Responses API in gateway adapter
  • Reset embedded assets and add css calc import
  • Use input_variables for template rendering
  • Format DB schema types and reorder SCHEMA_METADATA
  • Update generated embedded assets
  • Remove horizontal padding from prompt footer
  • Add Responses API token handling and reset assets
  • Add generated embedded assets
  • Add SavePromptPopup and integrate into column
  • Add SaveVariantPopup and enable source tracking
  • Add toast UI and playground-from-config hook
  • Add Evaluate in menu to variant header
  • Reset margins for dataset empty state text
  • Add playground-from-config endpoint
  • Update playgrounds.tsx to fix data fetching on selected row change
  • Use xs border radius for UI components
  • Add playground row detail view and navigation
  • Add playground execution hook with SSE
  • Add DatasetResultsSection component and styles
  • Extract dataset results section component
  • Add DatasetSelector combobox and styles
  • Add dataset selector and bottom panel
  • Add drag-and-drop for playground columns
  • Add PromptColumn UI with autosave and schema fix
  • Add toolbar to playground page
  • Remove playground UI components for user to implement
  • Add multi-column playground UI components
  • Add multi-column playground schema, API handlers, and client hooks
  • Add dataset records UI with CodeMirror editor
  • Add MVP Datasets feature with schema, data layer, API, and client hooks
  • Add Playgrounds API, data layer, and UI

v0.3.3

Other Changes

  • Add guardrail types and observability

v0.3.2

Bug Fixes

  • make guardrails available in production builds

Other Changes

  • Use import assertions for JSON imports
  • Add dialogDescription style and use it
  • design: redesign costs page with minimal typography layout
  • Adjust overview spacing and reorder stats
  • Load guardrails into manifest and use in gateway
  • Use logger instead of console in gatewayAdapter
  • Integrate guardrails from database into gateway requests
  • Fix table header and row alignment in guardrails UI
  • Fix guardrails UI toggle switch and badge styles
  • Add Collapsible and MessageBlock components
  • Add guardrails management UI and API

v0.3.1

Other Changes

  • Add Collapsible and MessageBlock components
  • Set fetch-depth to 0 for docs deploy workflow

v0.3.0

New Features

  • Add changelog page with auto-generated releases

Other Changes

  • Use design tokens for insight colors
  • Include Bootstrap basePath in curl builder URL
  • Add Gateway handbook page and update docs routes
  • Adjust overview styles and update hero text
  • Add fade-in animation to model selector popups
  • Improve overview page and onboarding flow
  • Type onMouseEnter handlers in ModelSelector
  • Rename API Usage page title and update icon
  • Enhance Gateway curl builder and inline select UI
  • Normalize quotes and add /github redirect
  • Always show environment and API key selects
  • Add interactive curl builder for Gateway usage
  • Add Gateway routes and move Providers UI
  • Add manifest routing service and credentials cache
  • fix readme railway link
  • Add Gateway sidebar item and guard headers

v0.2.14

Other Changes

  • Add Connect Provider link to model selector
  • Replace Combobox list with menu items
  • Refocus model search input on empty state change
  • Control ModelSelector; add provider and modelName
  • Add model params UI and extend model metadata
  • Add providers menubar and params popover
  • Add search filtering and styling to model selector
  • Add model selector with grouped models API and hook
  • Add slug support for provider configs
  • Embed generated assets and add adaptive favicon

v0.2.13

Other Changes

  • Add favicon, reset embedded assets, fix typo

v0.2.12

Other Changes

  • Add generated embedded assets and tweaks
  • Add Neon support and schema-qualified tables
  • Add Neon serverless support and PostgREST

v0.2.11

Other Changes

  • Rename Configs to Prompts and add header alias
  • Add provider config ID support and resolution
  • Support optional provider config name

v0.2.10

Other Changes

  • Include metadata only when store is enabled
  • Add Observability handbook page and meta entry
  • Add Nunjucks/Jinja2 support and generated assets

v0.2.9

Other Changes

  • Return new Response with updated headers

v0.2.8

Other Changes

  • Support Azure Foundry and deployment IDs
  • Add browser-safe provider mapping and logging
  • Add provider ID mapping and logging
  • Detect beta tag in CI and add embedded assets
  • Add provider ID mapping and Azure support

v0.2.7

Other Changes

  • Add Nunjucks template support and editor plugin
  • Add standalone Docker deployment docs

v0.2.6

Other Changes

  • Add generated embedded assets
  • Replace Discord link with Railway deploy button
  • Add Deploy Standalone LLMOps header

v0.2.5

Other Changes

  • Clarify onboarding copy about configs
  • Refactor onboarding flow to use react-hook-form
  • Add Discord support link, icon, and redirect route

v0.2.4

Other Changes

  • Use environment API key when copying curl command
  • Add deployment success dialog
  • Update onboarding title for no providers
  • Reset embedded assets for dev and add onboarding flow

v0.2.3

Other Changes

  • Allow dynamic trusted origins for auth client

v0.2.2

Other Changes

  • Initialize auth client only for API routes

v0.2.1

New Features

  • Add standalone dockerized LLMOps application

Other Changes

  • Bump Node base image to 24-alpine
  • Embed static assets and support single-file build
  • Add logging and options to MemoryCacheBackend
  • Add cache service for config/provider data

v0.2.0

Other Changes

  • Invert provider logos in dark mode
  • Move provider configuration to dashboard
  • Remove provider configs and fetch keys from DB
  • Add provider configs CRUD and UI
  • Bump dev dependencies and update lockfile and docs
  • Remove default auth credentials from docs example
  • Remove basicAuth docs and add forwardHeaders

v0.1.9

Other Changes

  • Set auth basePath and update sign-in navigation
  • Use promise chaining for sign-up flow
  • Use useNavigate to reload document after setup
  • Wire Better Auth hooks and add form validation
  • Remove basic auth implementation
  • Add Input component and update auth UI
  • Add single-user mode with super admin gating
  • Redesign auth pages with split layout and styles
  • Add user menu with theme switcher in sidebar
  • Add app wrapper route and session auth
  • Remove client-side auth redirects and loading
  • Provide Kysely DB and type to auth middleware
  • Add auth setup and signin pages and API
  • Integrate better-auth and remove autoMigrate option
  • Integrate better-auth migrations and rawConnection

v0.1.8

Other Changes

  • Remove debug console.log statements

v0.1.7

Other Changes

  • Add keywords to sdk package.json

v0.1.6

Other Changes

  • Enhance packages/sdk README
  • Document prompt management in README
  • Add contributing guide and update README
  • Add project description and badges to README
  • Support multi-value tag filters across analytics
  • Add observability filters and analytics params
  • Forward parent search in Observability sidebar
  • Track environmentId and tags in cost tracking
  • Add grouped cost summary with token totals
  • Add Recharts charts to observability overview
  • Remove comingSoon flag for Cost Tracking

v0.1.5

Other Changes

  • Include app basePath in API base URL
  • Remove cost breakdown and daily costs charts
  • Add paginated LLM requests and UI updates
  • Extract CSS and refactor observability components
  • Add observability date range picker and validation
  • Add observability UI and analytics backend
  • ‼️Vibe Coded: Add LLM cost tracking and analytics endpoints
  • Export cache module from core package

v0.1.4

Other Changes

  • Replace <br> spacer with styled section title
  • Expose auth type to client and adapt profile UI
  • Add workspace settings API and UI
  • Add Settings routes, sidebar and UI
  • Fix hero prompt link and adjust layout
  • Add LLMOps runbook and update hero prompt
  • Serve /llms.txt in dev instead of redirect
  • Add llms.txt API routes and redirect
  • Add llms.txt support and /api/llms-txt route
  • Add PostHog analytics to docs site
  • Bundle raw MDX and use virtual module in API
  • Add Copy Markdown button and /api/mdx route
  • Add Express and Hono integration docs

v0.1.3

Other Changes

  • Adjust editor placeholder spacing and line-height
  • Clarify LLMOps header and request guard comments
  • Use Authorization Bearer for environment secret
  • Migrate tests from Jest to Vitest

v0.1.2

Other Changes

  • Set configId and envSec in CORS branch
  • Remove enterprise-specific auth comments
  • Add authHandled flag and enterprise docs
  • Use basicAuth helper in docs examples
  • Add extensible auth module and basicAuth client
  • Add workspace_settings table and minor fixes
  • Add Base URL label and spacing

v0.1.1

Other Changes

  • Annotate Vite config with UserConfig type
  • Add copyable API base URL to overview
  • Remove Logo from empty configs state
  • Add EmptyConfigsState component and styles
  • Show empty state when no configs
  • Add favicon and copy public assets into build
  • Add configurable PostgreSQL schema support
  • Add handbook: configs, environments, variants
  • Add configuration and providers docs

v0.1.0

Other Changes

  • Format Quickstart iframe and fix props
  • Remove Supported Providers and update architecture
  • Add auto-migration support and middleware
  • Restructure docs and add Quickstart
  • Add integer and boolean type mappings for Postgres
  • Add CommonJS build and require-based env loading
  • Add CommonJS output and conditional exports
  • Add CJS build and conditional exports to SDK
  • Normalize pnpm-lock workspace specifiers
  • Use caret for workspace dependencies
  • Import dotenv in Express example
  • Rename package bin from @llmops/cli to cli
  • Enable public publishing and configure CLI
  • Set NPM auth and provenance in workflow
  • Remove npm publish env vars
  • Update build_and_deploy.yml
  • Add README headers for CLI and SDK packages
  • Add metadata and Apache-2.0 license to packages
  • Embed UI package into app and update imports
  • Run workspace builds serially
  • Allow prerelease tags without hyphen in workflow
  • Add Build and Deploy GitHub Actions workflow
  • Add Hono middleware and example
  • Remove Providers tab and add AI Gateway card
  • Change docs dev server port and remove debug log
  • Update deps, add CLI types, rename env param
  • All 10 PRs from Portkey-AI/gateway (Dec 22-24, 2025) have been synced: | PR | Description | Status | |-----|-------------|--------| | #1477 | Anthropic tool_choice=none | Already in codebase | | #1415 | Ollama thinking parameter | Completed (previous session) | | #1486 | Gemini reasoning effort fix | Completed (previous session) | | #1488 | Azure OpenAI batches URL fix | Completed (previous session) | | #1480 | Azure Shield Prompt/Protected Material plugins | Completed | | #1475 | Sequential guardrails execution | Completed | | #1478 | Google Maps grounding support | Completed | | #1479 | Transform type fixes | Completed | | #1481 | Not Null guardrail plugin | Completed | | #1471 | OVHcloud AI Endpoints provider | Completed |
  • Add typed provider configs and update schema
  • Use SupportedProviders to build providers schema
  • Move providers to gateway and add models.dev endpoints
  • Add Recent Configs Table to Overview
  • Display variant versions and fix subroute header
  • Move variant name to header and add version selector
  • Add many LLM providers and OpenAI support
  • Add Join Discord button to home hero
  • Update docs site layout and config
  • Add favicon link to root route
  • Add favicon for docs site
  • Center and size logo SVG
  • Invert footer logo in dark mode and add route
  • Load Cloudflare plugin only in production
  • Ignore .wrangler and update compatibility date
  • Remove prerender option from tanstackStart
  • Bump wrangler to 4.56.0 and update lockfile
  • Bump Wrangler to 4.54.0 in docs
  • Remove pnpm version pin from deploy docs
  • Add workflow to deploy docs to Cloudflare Workers
  • Update copyright to ByteByByte Ventures LLP
  • Add feature tabs, cards, animated logo and footer
  • Add animated hero with GitHub stars and copy
  • Show and copy config slug in header
  • Support short slugs for config IDs
  • Use useConfigById hook in ConfigsHeader
  • Require explicit variant versions and update API
  • Add variant version support and use latest by default
  • Add Product Handbook and homepage Features
  • Add Quickstart guide and fix middleware import
  • Add homepage hero, code editor, logo, and styles
  • Add docs site with Fumadocs and routing
  • Update README.md
  • Update README.md
  • Replace README with centered header and add images
  • Conditionally render ReactRefresh in dev
  • Remove settings route and clean up deps
  • Support SSE streaming in Express middleware
  • Add bumpp release config and bump package versions
  • Fix gateway adapter
  • Add gateway adapter
  • Remove gateway package .github files
  • add gateway package
  • Prevent deleting production environments
  • Redesign secrets list with visibility and copy
  • Extract tab styles to shared styles file
  • Add environment settings UI with delete flow
  • Add environment tabs and nested routes
  • Add secrets support for environments
  • Use environment param in navigate call
  • Add Environments UI, routes and hooks
  • Center new config state and add title
  • Add Swagger UI, request guard, and variant configs
  • Display new config state and add dark-mode logo
  • Add Tooltip component and use in sidebar
  • Add Settings link to sidebar and routes
  • Add app overview route and styles
  • Use lucide icons for table sort indicators
  • Add config deletion UI, hook, and server handler
  • Display provider icons in model settings
  • Refactor targeting form and simplify variant display
  • Add positionMethod prop to Popover
  • Refactor model settings popover UI
  • Add @base-ui/react and nested model menu
  • Add environment targeting UI and combobox variants
  • Make targeting conditions non-null
  • Add dark theme, custom scrollbars, and prefetch
  • Add query options, router context, and config endpoint
  • Add environments and targeting APIs and UI
  • Add targeting rules feature
  • Add Model Settings popover and UI primitives
  • Rename variant name to variant_name
  • Add environment and secret datalayers with seed
  • Bind system_prompt to Markdown editor
  • Add Markdown editor to variant form
  • Handle variant name and block unsaved navigation
  • Add inline combobox layout and action buttons
  • Remove unused import getConfigVariantsQueryKey
  • Add variants API and enable variant edit UI
  • Include variant name and simplify variants table
  • Add provider models and link variants to configs
  • Render provider icons in Combobox
  • Improve configs UI and combobox disabled state
  • Add inline combobox and style variant form
  • Add Combobox component and global theme
  • Remove buttonRecipe export from components index
  • Refactor configs routes and add variant support
  • Introduce _tabs route for config pages
  • Add variants and config-variant management
  • Add Tabs component and integrate into configs view
  • Use JSON for configs, honor basePath, fix DB URL
  • Switch to dark theme and improve config inputs
  • Integrate React Query and add configs CRUD
  • Add configs API and UI scaffolding
  • Add table component and react-table support
  • Add nested configs routes, outlet and overflow fix
  • Revamp Button component and Storybook theming
  • Add config data layer and zod schema validation
  • Replace Kysely adapter with db module
  • Add Zod-based DB schema and Kysely adapters
  • Rename BetterAuth types to LLMOps; adjust imports
  • Move Kysely adapter into core and add PG support
  • Add Kysely adapter and migration/generator CLI
  • Introduce DB adapter factory and SDK client
  • Add database config; update easing and types
  • Add environment_secrets and fix schema
  • Add twin-split layout with animated tile width
  • Add Overview sidebar item and route metadata
  • Extract AppSidebar and replace inline sidebar
  • Add Breadcrumbs component and route icons
  • Use node env and include Vite entry CSS
  • Use Jotai atom for sidebar collapse state
  • Animate sidebar width and add motion dependency
  • Add Drizzle ORM schema and DB deps
  • Add Configs route and show title in header
  • Add UI layout and server env validation
  • Refactor sidebar and styles; add layout route
  • Use CSS class and clsx instead of stylex
  • Migrate styles from stylex to vanilla-extract
  • Integrate TanStack Router and layout components
  • Validate LLMOps config at startup
  • Add OpenRouter provider and OpenAI integration
  • Add GenAI API handlers and request validation
  • Add Page component and global styles
  • Add app and ui packages and middleware
  • Add Express example and basic SDK middleware
  • Remove CLI package and add examples, parallel dev
  • Add initial README for LLMOps TypeScript workspace
  • Include JS in ESLint and add globals support
  • init