https://github.com/langfuse/langfuse Skip to content Navigation Menu Toggle navigation Sign in * Product + GitHub Copilot Write better code with AI + Security Find and fix vulnerabilities + Actions Automate any workflow + Codespaces Instant dev environments + Issues Plan and track work + Code Review Manage code changes + Discussions Collaborate outside of code + Code Search Find more, search less Explore + All features + Documentation + GitHub Skills + Blog * Solutions By company size + Enterprises + Small and medium teams + Startups By use case + DevSecOps + DevOps + CI/CD + View all use cases By industry + Healthcare + Financial services + Manufacturing + Government + View all industries View all solutions * Resources Topics + AI + DevOps + Security + Software Development + View all Explore + Learning Pathways + White papers, Ebooks, Webinars + Customer Stories + Partners + Executive Insights * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles Repositories + Topics + Trending + Collections * Enterprise + Enterprise platform AI-powered developer platform Available add-ons + Advanced Security Enterprise-grade security features + GitHub Copilot Enterprise-grade AI features + Premium Support Enterprise-grade 24/7 support * Pricing Search or jump to... Search code, repositories, users, issues, pull requests... Search [ ] Clear Search syntax tips Provide feedback We read every piece of feedback, and take your input very seriously. [ ] [ ] Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Name [ ] Query [ ] To see all available qualifiers, see our documentation. Cancel Create saved search Sign in Sign up Reseting focus You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} langfuse / langfuse Public * Notifications You must be signed in to change notification settings * Fork 667 * Star 7.2k Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. YC W23 langfuse.com/docs License View license 7.2k stars 667 forks Branches Tags Activity Star Notifications You must be signed in to change notification settings * Code * Issues 127 * Pull requests 55 * Discussions * Actions * Security * Insights Additional navigation options * Code * Issues * Pull requests * Discussions * Actions * Security * Insights langfuse/langfuse main BranchesTags [ ] Go to file Code Folders and files Last Last Name Name commit commit message date Latest commit History 3,236 Commits .github .github .husky .husky .vscode .vscode ee ee fern fern generated generated packages packages scripts scripts web web worker worker .codespellrc .codespellrc .dockerignore .dockerignore .env.dev-azure.example .env.dev-azure.example .env.dev.example .env.dev.example .env.dev.legacy.example .env.dev.legacy.example .env.prod.example .env.prod.example .eslintignore .eslintignore .gitignore .gitignore .npmrc .npmrc .nvmrc .nvmrc CONTRIBUTING.md CONTRIBUTING.md LICENSE LICENSE README.md README.md SECURITY.md SECURITY.md careers careers demo_thumbnail.jpg demo_thumbnail.jpg docker-compose.build.yml docker-compose.build.yml docker-compose.dev-azure.yml docker-compose.dev-azure.yml docker-compose.dev.yml docker-compose.dev.yml docker-compose.yml docker-compose.yml package.json package.json pnpm-lock.yaml pnpm-lock.yaml pnpm-workspace.yaml pnpm-workspace.yaml turbo.json turbo.json View all files Repository files navigation * README * License * Security Langfuse GitHub Banner Langfuse: Open Source LLM Engineering Platform LLM Observability, Prompt Management, LLM Evaluations, Datasets, LLM Metrics, and Prompt Playground Sign up * Self Host * Demo (live data) Docs * Report Bug * Feature Request * Changelog * Roadmap * Discord Langfuse uses Github Discussions for Support and Feature Requests. We're hiring. Join us in Product Engineering and Developer Relations. MIT License Y Combinator W23 Docker Image langfuse Python package on PyPi langfuse npm package Langfuse Overview Langfuse Overview Video Develop * LLM Observability: Instrument your app and start ingesting traces to Langfuse (Quickstart, Integrations Tracing) * Langfuse UI: Inspect and debug complex logs (Demo, Tracing) * Prompt Management: Manage, version and deploy prompts from within Langfuse (Prompt Management) * Prompt Engineering: Test and iterate on your prompts with the LLM Playground Monitor * LLM Analytics: Track metrics (cost, latency, quality) and gain insights from dashboards & data exports (Analytics) * LLM Evaluations: Collect and calculate scores for your LLM completions (Scores & Evaluations) + Run (Model-based evaluations) and LLM-as-a-Judge within Langfuse + Collect user feedback (User Feedback) + Manually score LLM outputs in Langfuse (Manual Scores) Test * Experiments: Track and test app behaviour before deploying a new version + Datasets let you test expected in and output pairs and benchmark performance before deploying (Datasets) + Track versions and releases in your application ( Experimentation, Prompt Management) Get started Langfuse Cloud Managed deployment by the Langfuse team, generous free-tier (hobby plan), no credit card required. >> Langfuse Cloud Self-Hosting Open Source LLM Observability with Langfuse Localhost (docker) # Clone repository git clone https://github.com/langfuse/langfuse.git cd langfuse # Run server and database docker compose up -d - Learn more about deploying locally Self-host (docker) Langfuse is simple to self-host and keep updated. It currently requires only a single docker container and a postgres database. - Self Hosting Instructions Templated deployments: Railway, GCP, AWS, Azure, Kubernetes and others Get Started API Keys You need a Langfuse public and secret key to get started. Sign up here and find them in your project settings. Ingesting Data * Instrumenting Your Application * LLM Observability with Langfuse Note: We recommend using our fully async, typed SDKs that allow you to instrument any LLM application with any underlying model. They are available in Python (Decorators) & JS/TS. The SDKs will always be the most fully featured and stable way to ingest data into Langfuse. See the - Quickstart to integrate Langfuse. LLM Observability Integrations Integration Supports Description SDK Python, JS Manual instrumentation using the SDKs for full /TS flexibility. OpenAI Python, JS Automated instrumentation using drop-in /TS replacement of OpenAI SDK. Langchain Python, JS Automated instrumentation by passing callback /TS handler to Langchain application. LlamaIndex Python Automated instrumentation via LlamaIndex callback system. Haystack Python Automated instrumentation via Haystack content tracing system. Python, JS Use any LLM as a drop in replacement for GPT. LiteLLM /TS (proxy Use Azure, OpenAI, Cohere, Anthropic, Ollama, only) VLLM, Sagemaker, HuggingFace, Replicate (100+ LLMs). Vercel AI TypeScript toolkit designed to help developers SDK JS/TS build AI-powered applications with React, Next.js, Vue, Svelte, Node.js. API Directly call the public API. OpenAPI spec available. Packages integrated with Langfuse: Name Description Instructor Library to get structured LLM outputs (JSON, Pydantic) Dify Open source LLM app development platform with no-code builder. Ollama Easily run open source LLMs on your own machine. Mirascope Python toolkit for building LLM applications. Flowise JS/TS no-code builder for customized LLM flows. Python-based UI for LangChain, designed with react-flow to Langflow provide an effortless way to experiment and prototype flows. Questions and feedback Ideas and roadmap * Roadmap * GitHub Discussions * Feature Requests Support and feedback In order of preference the best way to communicate with us: * GitHub Discussions (preferred): Contribute ideas, support requests and report bugs * Discord: community support * Privately: contact at langfuse dot com Contributing to Langfuse * Vote on Ideas * Raise and comment on Issues * Open a PR - see CONTRIBUTING.md for details on how to setup a development environment. License This repository is MIT licensed, except for the ee folders. See LICENSE and docs for more details. Misc GET API to export your data GET routes to use data in downstream applications (e.g. embedded analytics). You can also access them conveniently via the SDKs (docs ). Security & Privacy We take data security and privacy seriously. Please refer to our Security and Privacy page for more information. Telemetry By default, Langfuse automatically reports basic usage statistics of self-hosted instances to a centralized server (PostHog). This helps us to: 1. Understand how Langfuse is used and improve the most relevant features. 2. Track overall usage for internal and external (e.g. fundraising) reporting. None of the data is shared with third parties and does not include any sensitive information. We want to be super transparent about this and you can find the exact data we collect here. You can opt-out by setting TELEMETRY_ENABLED=false. Star History Star History Chart Open Source Projects Using Langfuse Top open-source Python projects that use Langfuse, ranked by stars ( Source): Repository Stars # langgenius / dify 54865 # open-webui / open-webui 51531 # lobehub / lobe-chat 49003 # langflow-ai / langflow 39093 # run-llama / llama_index 37368 # chatchat-space / Langchain-Chatchat 32486 # FlowiseAI / Flowise 32448 # mindsdb / mindsdb 26931 # twentyhq / twenty 24195 # PostHog / posthog 22618 # BerriAI / litellm 15151 # mediar-ai / screenpipe 11037 # formbricks / formbricks 9386 # anthropics / courses 8385 # GreyDGL / PentestGPT 7374 # superagent-ai / superagent 5391 # promptfoo / promptfoo 4976 # onlook-dev / onlook 4141 # Canner / WrenAI 2526 # pingcap / autoflow 2061 # MLSysOps / MLE-agent 1161 # open-webui / pipelines 1100 # alishobeiri / thread 1074 # topoteretes / cognee 971 # bRAGAI / bRAG-langchain 823 # opslane / opslane 677 # dynamiq-ai / dynamiq 639 # theopenconversationkit / tock 514 # andysingal / llm-course 394 # phospho-app / phospho 384 # sentient-engineering / agent-q 370 # sql-agi / DB-GPT 324 # PostHog / posthog-foss 305 # vespperhq / vespper 304 # block / goose 295 # aorwall / moatless-tools 291 # dmayboroda / minima 221 # RobotecAI / rai 172 # i-am-alice / 3rd-devs 148 # 8090-inc / xrx-sample-apps 138 # babelcloud / LLM-RGB 135 # souzatharsis / tamingLLMs 129 # LibreChat-AI / librechat.ai 128 # deepset-ai / haystack-core-integrations 126 About Open source LLM engineering platform: LLM Observability, metrics, evals, prompt management, playground, datasets. Integrates with LlamaIndex, Langchain, OpenAI SDK, LiteLLM, and more. YC W23 langfuse.com/docs Topics open-source playground monitoring analytics evaluation self-hosted ycombinator openai gpt hacktoberfest observability large-language-models llm prompt-engineering langchain llmops llama-index prompt-management llm-evaluation llm-observability Resources Readme License View license Security policy Security policy Activity Custom properties Stars 7.2k stars Watchers 28 watching Forks 667 forks Report repository Releases 278 v3.2.0 Latest Dec 16, 2024 + 277 releases Packages 0 Contributors 61 * @marcklingen * @maxdeichmann * @dependabot[bot] * @marliessophie * @Steffen911 * @hassiebp * @RichardKruemmel * @clemra * @porter-deployment-app[bot] * @gitstart-app[bot] * @TameemAsim * @flxwu * @khareyash05 * @eltociear + 47 contributors Languages * TypeScript 98.5% * Other 1.5% Footer (c) 2024 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact * Manage cookies * Do not share my personal information You can't perform that action at this time.