https://github.com/openlit/openlit Skip to content Navigation Menu Toggle navigation Sign in * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code Explore + All features + Documentation + GitHub Skills + Blog * Solutions For + Enterprise + Teams + Startups + Education By Solution + CI/CD & Automation + DevOps + DevSecOps Resources + Learning Pathways + White papers, Ebooks, Webinars + Customer Stories + Partners * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles Repositories + Topics + Trending + Collections * Pricing Search or jump to... Search code, repositories, users, issues, pull requests... Search [ ] Clear Search syntax tips Provide feedback We read every piece of feedback, and take your input very seriously. [ ] [ ] Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Name [ ] Query [ ] To see all available qualifiers, see our documentation. Cancel Create saved search Sign in Sign up You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} openlit / openlit Public * Notifications * Fork 9 * Star 159 * OpenLIT is an open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics in a single application . Open source GenAI and LLM Application Performance Monitoring (APM) & Observability tool docs.openlit.io License Apache-2.0 license 159 stars 9 forks Branches Tags Activity Star Notifications * Code * Issues 7 * Pull requests 4 * Discussions * Actions * Projects 1 * Security * Insights Additional navigation options * Code * Issues * Pull requests * Discussions * Actions * Projects * Security * Insights openlit/openlit This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. main BranchesTags Go to file Code Folders and files Name Name Last commit Last commit message date Latest commit History 175 Commits .github .github assets assets docs docs sdk/python sdk/python src src .gitignore .gitignore CODEOWNERS CODEOWNERS CODE_OF_CONDUCT.md CODE_OF_CONDUCT.md CONTRIBUTING.md CONTRIBUTING.md LICENSE LICENSE README.md README.md SECURITY.md SECURITY.md docker-compose.yml docker-compose.yml package-lock.json package-lock.json View all files Repository files navigation * README * Code of conduct * Apache-2.0 license * Security OpenLIT Logo OpenTelemetry-native LLM Application Observability Documentation | Quickstart | Python SDK OpenLIT License Downloads GitHub Last Commit GitHub Contributors Slack X OpenLIT Banner OpenLIT is an OpenTelemetry-native GenAI and LLM Application Observability tool. It's designed to make the integration process of observability into GenAI projects as easy as pie - literally, with just a single line of code. Whether you're working with popular LLM Libraries such as OpenAI and HuggingFace or leveraging vector databases like ChromaDB, OpenLIT ensures your applications are monitored seamlessly, providing critical insights to improve performance and reliability. This project proudly follows the Semantic Conventions of the OpenTelemetry community, consistently updating to align with the latest standards in observability. What is LIT? LIT stands for Learning Interpretability Tool. It refers to a visual, interactive model-understanding and data visualization tool ad a term introduced by Google. [?] Features * OpenTelemetry-native: Native support ensures that integrating OpenLIT into your projects feels more like a natural extension rather than an additional layer of complexity. * Granular Usage Insights of your LLM Applications: Assess your LLM's performance and costs with fine-grained control, breaking down metrics by environment (such as staging or production) or application, to optimize for efficiency and scalability. * Vendor-Neutral SDKs: In the spirit of OpenTelemetry, OpenLIT's SDKs are agnostic of the backend vendors. This means you can confidently use OpenLIT with various telemetry backends, like Grafana Tempo, without worrying about compatibility issues. Getting Started Step 1: Deploy OpenLIT From the root directory of the this Repo, Run the below command: docker-compose up -d Step 2: Install OpenLIT SDK pip install openlit Step 2: Instrument your Application Integrating the OpenLIT into LLM applications is straightforward. Start monitoring for your LLM Application with just one line of code: import openlit openlit.init(otlp_endpoint="http://127.0.0.1:4318") To forward telemetry data to an HTTP OTLP endpoint, such as the OpenTelemetry Collector, set the otlp_endpoint parameter with the desired endpoint. Alternatively, you can configure the endpoint by setting the OTEL_EXPORTER_OTLP_ENDPOINT environment variable as recommended in the OpenTelemetry documentation. Info: If you dont provide otlp_endpoint function argument or set the OTEL_EXPORTER_OTLP_ENDPOINT environment variable, The SDK directs the trace directly to your console, which can be useful during development. To send telemetry to OpenTelemetry backends requiring authentication, set the otlp_headers parameter with its desired value. Alternatively, you can configure the endpoint by setting the OTEL_EXPORTER_OTLP_HEADERS environment variable as recommended in the OpenTelemetry documentation. Example Here is how you can send telemetry from OpenLIT to Grafana Cloud openlit.init( otlp_endpoint="https://otlp-gateway-prod-us-east-0.grafana.net/otlp", otlp_headers="Authorization=Basic%20" ) Alternatively, You can also choose to set these values using OTEL_EXPORTER_OTLP_ENDPOINT and OTEL_EXPORTER_OTLP_HEADERS environment variables openlit.init() export OTEL_EXPORTER_OTLP_ENDPOINT = "https://otlp-gateway-prod-us-east-0.grafana.net/otlp" export OTEL_EXPORTER_OTLP_HEADERS = "Authorization=Basic%20" Step 3: Visualize and Optimize! With the LLM Observability data now being collected and sent to OpenLIT, the next step is to visualize and analyze this data to get insights into your LLM application's performance, behavior, and identify areas of improvement. Just head over to OpenLIT UI at 127.0.0.1:3000 on your browser to start exploring. [openlit-cl] [openlit-cl] Contributing Whether it's big or small, we love contributions . Check out our Contribution guide to get started Unsure where to start? Here are a few ways to get involved: * Join our Slack channel to discuss ideas, share feedback, and connect with both our team and the wider OpenLIT community. Your input helps us grow and improve, and we're here to support you every step of the way. Community & Support Connect with the OpenLIT community and maintainers for support, discussions, and updates: * If you like it, Leave a star on our GitHub * Join our Slack Community for live interactions and questions. * Report bugs on our GitHub Issues to help us improve OpenLIT. * X Follow us on X for the latest updates and news. License OpenLIT is available under the Apache-2.0 license. Visualize! Analyze! Optimize! Join us on this voyage to reshape the future of AI Observability. Share your thoughts, suggest features, and explore contributions. Engage with us on GitHub and be part of OpenLIT's community-led innovation. About OpenLIT is an open-source GenAI and LLM observability platform native to OpenTelemetry with traces and metrics in a single application . Open source GenAI and LLM Application Performance Monitoring (APM) & Observability tool docs.openlit.io Topics python open-source metrics clickhouse grafana tracing openai observability distributed-tracing typescipt monitoring-tool otel opentelemetry otlp ai-observability llms langchain llmops anthropic genai Resources Readme License Apache-2.0 license Code of conduct Code of conduct Security policy Security policy Activity Custom properties Stars 159 stars Watchers 3 watching Forks 9 forks Report repository Releases 15 openlit-1.0.0 Latest Apr 26, 2024 + 14 releases Packages 3 Contributors 5 * @patcher9 * @dependabot[bot] * @AmanAgarwal041 * @patcher99 * @fpreiss Languages * Python 66.8% * TypeScript 32.4% * Other 0.8% Footer (c) 2024 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact * Manage cookies * Do not share my personal information You can't perform that action at this time.