Changelog
All notable changes to LLMOps are documented here.
Other Changes
- •Fix cost legend layout to display items vertically (#44)
Other Changes
- •Add conductor.json with setup and run scripts (#43)
- •Add cost breakdown grouping options (model, endpoint, tags) (#40)
New Features
- •make llmops config entirely optional with defaults (#42)
New Features
- •add inline gateway client interface via provider() (#41)
New Features
- •inline provider configuration with auto-detection (#38)
Other Changes
- •Add Next.js integration to SDK (#35)
Other Changes
- •add embedding params to the gateway adapter
Other Changes
- •Set default cookie prefix for auth client
Other Changes
- •Embed generated client assets and manifest
Other Changes
- •Add endpoint column to observability requests table (#34)
Other Changes
- •Add createModelResponse support for Azure AI Inference provider (#33)
Other Changes
- •Fix playground execute for reverse proxy deployments (#32)
- •Add generated embedded assets and manifest
- •Fix basePath handling for playground execute endpoints
- •Fix curl builder link overflow
- •Add Docs link and restyle GitHub button
Other Changes
- •Exclude stream_options from Responses config
- •Use flat spread for DataLayer to maintain backwards compatibility
- •Refactor datalayer exports; re-export schema types
- •Add DataLayer interface and factory function
New Features
- •add Playgrounds feature to sidebar and routing
Other Changes
- •Support Responses API in gateway adapter
- •Reset embedded assets and add css calc import
- •Use input_variables for template rendering
- •Format DB schema types and reorder SCHEMA_METADATA
- •Update generated embedded assets
- •Remove horizontal padding from prompt footer
- •Add Responses API token handling and reset assets
- •Add generated embedded assets
- •Add SavePromptPopup and integrate into column
- •Add SaveVariantPopup and enable source tracking
- •Add toast UI and playground-from-config hook
- •Add Evaluate in menu to variant header
- •Reset margins for dataset empty state text
- •Add playground-from-config endpoint
- •Update playgrounds.tsx to fix data fetching on selected row change
- •Use xs border radius for UI components
- •Add playground row detail view and navigation
- •Add playground execution hook with SSE
- •Add DatasetResultsSection component and styles
- •Extract dataset results section component
- •Add DatasetSelector combobox and styles
- •Add dataset selector and bottom panel
- •Add drag-and-drop for playground columns
- •Add PromptColumn UI with autosave and schema fix
- •Add toolbar to playground page
- •Remove playground UI components for user to implement
- •Add multi-column playground UI components
- •Add multi-column playground schema, API handlers, and client hooks
- •Add dataset records UI with CodeMirror editor
- •Add MVP Datasets feature with schema, data layer, API, and client hooks
- •Add Playgrounds API, data layer, and UI
Other Changes
- •Add guardrail types and observability
Bug Fixes
- •make guardrails available in production builds
Other Changes
- •Use import assertions for JSON imports
- •Add dialogDescription style and use it
- •design: redesign costs page with minimal typography layout
- •Adjust overview spacing and reorder stats
- •Load guardrails into manifest and use in gateway
- •Use logger instead of console in gatewayAdapter
- •Integrate guardrails from database into gateway requests
- •Fix table header and row alignment in guardrails UI
- •Fix guardrails UI toggle switch and badge styles
- •Add Collapsible and MessageBlock components
- •Add guardrails management UI and API
Other Changes
- •Add Collapsible and MessageBlock components
- •Set fetch-depth to 0 for docs deploy workflow
New Features
- •Add changelog page with auto-generated releases
Other Changes
- •Use design tokens for insight colors
- •Include Bootstrap basePath in curl builder URL
- •Add Gateway handbook page and update docs routes
- •Adjust overview styles and update hero text
- •Add fade-in animation to model selector popups
- •Improve overview page and onboarding flow
- •Type onMouseEnter handlers in ModelSelector
- •Rename API Usage page title and update icon
- •Enhance Gateway curl builder and inline select UI
- •Normalize quotes and add /github redirect
- •Always show environment and API key selects
- •Add interactive curl builder for Gateway usage
- •Add Gateway routes and move Providers UI
- •Add manifest routing service and credentials cache
- •fix readme railway link
- •Add Gateway sidebar item and guard headers
Other Changes
- •Add Connect Provider link to model selector
- •Replace Combobox list with menu items
- •Refocus model search input on empty state change
- •Control ModelSelector; add provider and modelName
- •Add model params UI and extend model metadata
- •Add providers menubar and params popover
- •Add search filtering and styling to model selector
- •Add model selector with grouped models API and hook
- •Add slug support for provider configs
- •Embed generated assets and add adaptive favicon
Other Changes
- •Add favicon, reset embedded assets, fix typo
Other Changes
- •Add generated embedded assets and tweaks
- •Add Neon support and schema-qualified tables
- •Add Neon serverless support and PostgREST
Other Changes
- •Rename Configs to Prompts and add header alias
- •Add provider config ID support and resolution
- •Support optional provider config name
Other Changes
- •Include metadata only when store is enabled
- •Add Observability handbook page and meta entry
- •Add Nunjucks/Jinja2 support and generated assets
Other Changes
- •Return new Response with updated headers
Other Changes
- •Support Azure Foundry and deployment IDs
- •Add browser-safe provider mapping and logging
- •Add provider ID mapping and logging
- •Detect beta tag in CI and add embedded assets
- •Add provider ID mapping and Azure support
Other Changes
- •Add Nunjucks template support and editor plugin
- •Add standalone Docker deployment docs
Other Changes
- •Add generated embedded assets
- •Replace Discord link with Railway deploy button
- •Add Deploy Standalone LLMOps header
Other Changes
- •Clarify onboarding copy about configs
- •Refactor onboarding flow to use react-hook-form
- •Add Discord support link, icon, and redirect route
Other Changes
- •Use environment API key when copying curl command
- •Add deployment success dialog
- •Update onboarding title for no providers
- •Reset embedded assets for dev and add onboarding flow
Other Changes
- •Allow dynamic trusted origins for auth client
Other Changes
- •Initialize auth client only for API routes
New Features
- •Add standalone dockerized LLMOps application
Other Changes
- •Bump Node base image to 24-alpine
- •Embed static assets and support single-file build
- •Add logging and options to MemoryCacheBackend
- •Add cache service for config/provider data
Other Changes
- •Invert provider logos in dark mode
- •Move provider configuration to dashboard
- •Remove provider configs and fetch keys from DB
- •Add provider configs CRUD and UI
- •Bump dev dependencies and update lockfile and docs
- •Remove default auth credentials from docs example
- •Remove basicAuth docs and add forwardHeaders
Other Changes
- •Set auth basePath and update sign-in navigation
- •Use promise chaining for sign-up flow
- •Use useNavigate to reload document after setup
- •Wire Better Auth hooks and add form validation
- •Remove basic auth implementation
- •Add Input component and update auth UI
- •Add single-user mode with super admin gating
- •Redesign auth pages with split layout and styles
- •Add user menu with theme switcher in sidebar
- •Add app wrapper route and session auth
- •Remove client-side auth redirects and loading
- •Provide Kysely DB and type to auth middleware
- •Add auth setup and signin pages and API
- •Integrate better-auth and remove autoMigrate option
- •Integrate better-auth migrations and rawConnection
Other Changes
- •Remove debug console.log statements
Other Changes
- •Add keywords to sdk package.json
Other Changes
- •Enhance packages/sdk README
- •Document prompt management in README
- •Add contributing guide and update README
- •Add project description and badges to README
- •Support multi-value tag filters across analytics
- •Add observability filters and analytics params
- •Forward parent search in Observability sidebar
- •Track environmentId and tags in cost tracking
- •Add grouped cost summary with token totals
- •Add Recharts charts to observability overview
- •Remove comingSoon flag for Cost Tracking
Other Changes
- •Include app basePath in API base URL
- •Remove cost breakdown and daily costs charts
- •Add paginated LLM requests and UI updates
- •Extract CSS and refactor observability components
- •Add observability date range picker and validation
- •Add observability UI and analytics backend
- •‼️Vibe Coded: Add LLM cost tracking and analytics endpoints
- •Export cache module from core package
Other Changes
- •Replace <br> spacer with styled section title
- •Expose auth type to client and adapt profile UI
- •Add workspace settings API and UI
- •Add Settings routes, sidebar and UI
- •Fix hero prompt link and adjust layout
- •Add LLMOps runbook and update hero prompt
- •Serve /llms.txt in dev instead of redirect
- •Add llms.txt API routes and redirect
- •Add llms.txt support and /api/llms-txt route
- •Add PostHog analytics to docs site
- •Bundle raw MDX and use virtual module in API
- •Add Copy Markdown button and /api/mdx route
- •Add Express and Hono integration docs
Other Changes
- •Adjust editor placeholder spacing and line-height
- •Clarify LLMOps header and request guard comments
- •Use Authorization Bearer for environment secret
- •Migrate tests from Jest to Vitest
Other Changes
- •Set configId and envSec in CORS branch
- •Remove enterprise-specific auth comments
- •Add authHandled flag and enterprise docs
- •Use basicAuth helper in docs examples
- •Add extensible auth module and basicAuth client
- •Add workspace_settings table and minor fixes
- •Add Base URL label and spacing
Other Changes
- •Annotate Vite config with UserConfig type
- •Add copyable API base URL to overview
- •Remove Logo from empty configs state
- •Add EmptyConfigsState component and styles
- •Show empty state when no configs
- •Add favicon and copy public assets into build
- •Add configurable PostgreSQL schema support
- •Add handbook: configs, environments, variants
- •Add configuration and providers docs
Other Changes
- •Format Quickstart iframe and fix props
- •Remove Supported Providers and update architecture
- •Add auto-migration support and middleware
- •Restructure docs and add Quickstart
- •Add integer and boolean type mappings for Postgres
- •Add CommonJS build and require-based env loading
- •Add CommonJS output and conditional exports
- •Add CJS build and conditional exports to SDK
- •Normalize pnpm-lock workspace specifiers
- •Use caret for workspace dependencies
- •Import dotenv in Express example
- •Rename package bin from @llmops/cli to cli
- •Enable public publishing and configure CLI
- •Set NPM auth and provenance in workflow
- •Remove npm publish env vars
- •Update build_and_deploy.yml
- •Add README headers for CLI and SDK packages
- •Add metadata and Apache-2.0 license to packages
- •Embed UI package into app and update imports
- •Run workspace builds serially
- •Allow prerelease tags without hyphen in workflow
- •Add Build and Deploy GitHub Actions workflow
- •Add Hono middleware and example
- •Remove Providers tab and add AI Gateway card
- •Change docs dev server port and remove debug log
- •Update deps, add CLI types, rename env param
- •All 10 PRs from Portkey-AI/gateway (Dec 22-24, 2025) have been synced: | PR | Description | Status | |-----|-------------|--------| | #1477 | Anthropic tool_choice=none | Already in codebase | | #1415 | Ollama thinking parameter | Completed (previous session) | | #1486 | Gemini reasoning effort fix | Completed (previous session) | | #1488 | Azure OpenAI batches URL fix | Completed (previous session) | | #1480 | Azure Shield Prompt/Protected Material plugins | Completed | | #1475 | Sequential guardrails execution | Completed | | #1478 | Google Maps grounding support | Completed | | #1479 | Transform type fixes | Completed | | #1481 | Not Null guardrail plugin | Completed | | #1471 | OVHcloud AI Endpoints provider | Completed |
- •Add typed provider configs and update schema
- •Use SupportedProviders to build providers schema
- •Move providers to gateway and add models.dev endpoints
- •Add Recent Configs Table to Overview
- •Display variant versions and fix subroute header
- •Move variant name to header and add version selector
- •Add many LLM providers and OpenAI support
- •Add Join Discord button to home hero
- •Update docs site layout and config
- •Add favicon link to root route
- •Add favicon for docs site
- •Center and size logo SVG
- •Invert footer logo in dark mode and add route
- •Load Cloudflare plugin only in production
- •Ignore .wrangler and update compatibility date
- •Remove prerender option from tanstackStart
- •Bump wrangler to 4.56.0 and update lockfile
- •Bump Wrangler to 4.54.0 in docs
- •Remove pnpm version pin from deploy docs
- •Add workflow to deploy docs to Cloudflare Workers
- •Update copyright to ByteByByte Ventures LLP
- •Add feature tabs, cards, animated logo and footer
- •Add animated hero with GitHub stars and copy
- •Show and copy config slug in header
- •Support short slugs for config IDs
- •Use useConfigById hook in ConfigsHeader
- •Require explicit variant versions and update API
- •Add variant version support and use latest by default
- •Add Product Handbook and homepage Features
- •Add Quickstart guide and fix middleware import
- •Add homepage hero, code editor, logo, and styles
- •Add docs site with Fumadocs and routing
- •Update README.md
- •Update README.md
- •Replace README with centered header and add images
- •Conditionally render ReactRefresh in dev
- •Remove settings route and clean up deps
- •Support SSE streaming in Express middleware
- •Add bumpp release config and bump package versions
- •Fix gateway adapter
- •Add gateway adapter
- •Remove gateway package .github files
- •add gateway package
- •Prevent deleting production environments
- •Redesign secrets list with visibility and copy
- •Extract tab styles to shared styles file
- •Add environment settings UI with delete flow
- •Add environment tabs and nested routes
- •Add secrets support for environments
- •Use environment param in navigate call
- •Add Environments UI, routes and hooks
- •Center new config state and add title
- •Add Swagger UI, request guard, and variant configs
- •Display new config state and add dark-mode logo
- •Add Tooltip component and use in sidebar
- •Add Settings link to sidebar and routes
- •Add app overview route and styles
- •Use lucide icons for table sort indicators
- •Add config deletion UI, hook, and server handler
- •Display provider icons in model settings
- •Refactor targeting form and simplify variant display
- •Add positionMethod prop to Popover
- •Refactor model settings popover UI
- •Add @base-ui/react and nested model menu
- •Add environment targeting UI and combobox variants
- •Make targeting conditions non-null
- •Add dark theme, custom scrollbars, and prefetch
- •Add query options, router context, and config endpoint
- •Add environments and targeting APIs and UI
- •Add targeting rules feature
- •Add Model Settings popover and UI primitives
- •Rename variant name to variant_name
- •Add environment and secret datalayers with seed
- •Bind system_prompt to Markdown editor
- •Add Markdown editor to variant form
- •Handle variant name and block unsaved navigation
- •Add inline combobox layout and action buttons
- •Remove unused import getConfigVariantsQueryKey
- •Add variants API and enable variant edit UI
- •Include variant name and simplify variants table
- •Add provider models and link variants to configs
- •Render provider icons in Combobox
- •Improve configs UI and combobox disabled state
- •Add inline combobox and style variant form
- •Add Combobox component and global theme
- •Remove buttonRecipe export from components index
- •Refactor configs routes and add variant support
- •Introduce _tabs route for config pages
- •Add variants and config-variant management
- •Add Tabs component and integrate into configs view
- •Use JSON for configs, honor basePath, fix DB URL
- •Switch to dark theme and improve config inputs
- •Integrate React Query and add configs CRUD
- •Add configs API and UI scaffolding
- •Add table component and react-table support
- •Add nested configs routes, outlet and overflow fix
- •Revamp Button component and Storybook theming
- •Add config data layer and zod schema validation
- •Replace Kysely adapter with db module
- •Add Zod-based DB schema and Kysely adapters
- •Rename BetterAuth types to LLMOps; adjust imports
- •Move Kysely adapter into core and add PG support
- •Add Kysely adapter and migration/generator CLI
- •Introduce DB adapter factory and SDK client
- •Add database config; update easing and types
- •Add environment_secrets and fix schema
- •Add twin-split layout with animated tile width
- •Add Overview sidebar item and route metadata
- •Extract AppSidebar and replace inline sidebar
- •Add Breadcrumbs component and route icons
- •Use node env and include Vite entry CSS
- •Use Jotai atom for sidebar collapse state
- •Animate sidebar width and add motion dependency
- •Add Drizzle ORM schema and DB deps
- •Add Configs route and show title in header
- •Add UI layout and server env validation
- •Refactor sidebar and styles; add layout route
- •Use CSS class and clsx instead of stylex
- •Migrate styles from stylex to vanilla-extract
- •Integrate TanStack Router and layout components
- •Validate LLMOps config at startup
- •Add OpenRouter provider and OpenAI integration
- •Add GenAI API handlers and request validation
- •Add Page component and global styles
- •Add app and ui packages and middleware
- •Add Express example and basic SDK middleware
- •Remove CLI package and add examples, parallel dev
- •Add initial README for LLMOps TypeScript workspace
- •Include JS in ESLint and add globals support
- •init