A pluggable LLMOps toolkit for TypeScript applications

Read https://llmops.build/llms.txt/runbook.md and integrate LLMOps in this application.
Use a separate branch for the changes.
GitHubllmops-build/llmops
Get Started →Deploy on Railway

Features

AI Gateway

OpenAI-compatible gateway to connect to 1600+ LLMs from 70+ providers with unified API.

Prompt Management

Version, test, and deploy prompts with a visual editor.

Cost Tracking

Monitor and analyze LLM usage costs across providers and models.

ObservabilityComing Soon

Trace requests, debug issues, and gain insights into your LLM pipelines.

Middlewares

Express

Integrate LLMOps with your Express.js applications using our middleware.

Hono

Lightweight middleware for Hono framework with full TypeScript support.

Next.jsComing Soon

Seamless integration with Next.js API routes and server actions.

NestJSComing Soon

Decorator-based integration for NestJS applications.

Integrations

Cloudflare StackComing Soon

D1 database, Workers, and AI Gateway integration.

Vercel StackComing Soon

Postgres, Edge Functions, and AI Gateway integration.