https://www.evidentlyai.com/ml-system-design Give us a star [?] on GitHub to support the project! Join us November 30 for the Evidently monthly demo and Q&A. Register now - Evidently AI logo Product Open-source Overview Evidently Reports Evidently Test Suites Evidently ML Monitoring Data Quality Data Drift ML Model Performance NLP and LLM Entreprise Evidently Cloud Pricing Docs Community Learn Resources Blog Tutorials Guides Special projects ML platforms ML use cases MLOps course Open-source ML observability course Open sourceCloud Evidently AI logo Product OPEN-SOURCE [64b3] Overview Evidently at a glance [64b5] Evidently Reports Instantly visualize ML models and data [64b3] Evidently Test Suites Structured checks for data and models [64b3] Evidently ML Monitoring A centralized hub for ML in production Special projects [64b3] Data Quality Monitor data quality and integrity [64b3] Data Drift Monitor data distribution shifts [64b3] ML Model Performance Monitor ML model quality and errors [64b3] NLP and LLM Monitor text-based models and data ENTERPRISE Evidently Cloud Evidently Cloud platform is in the works. Join the waitlist to be the first to try it. Evidently ML observability platformJoin the waitlist - PricingDocs Learn Resources [64b5] Blog Insights on doing ML in production [64b3] Tutorials ML monitoring and MLOps tutorials [64b3] Guides Explainers and in-depth MLOps guides Special projects [64b2] ML platforms 45+ internal ML platforms [64b3] ML use cases 300+ ML case studies MLOPS course Open-source ML observability course Sign up to learn production ML monitoring. Evidently Getting Started tutorialSign up now - Community GitHub OPEN SOURCEcloud LAST UPDATED: december 2, 2023 ML system design: 300 case studies to learn from How do companies like Netflix, Airbnb, and Doordash apply machine learning to improve their products and processes? We put together a database of 300 case studies from 80+ companies that share practical ML use cases and learnings from designing ML systems. Navigation tips. You can play around with the database by filtering case studies by industry or ML use case. We added tags based on recurring themes. This is not a perfect or mutually exclusive division, but you can use the tags to quickly find: * ML systems with different data types: computer vision (CV) or natural language processing (NLP). * ML systems for specific use cases. The most popular are recommender systems, search and ranking, and fraud detection. * We also labeled use cases where ML powers a specific user-facing "product feature": from grammatical error correction to generating outfit combinations. Enjoy the reading! And if you find the database helpful, spread the word. Real-world ML systems All the content belongs to respective parties. We simply put the links together Selection criteria. Here is how we selected the case studies to include: * It is a blog, paper, or article about a machine learning system created in-house (not by a vendor that sells or implements ML solutions for others). * It has sufficient detail on the ML use case and implementation: who the model is for, the ML model design, evaluation criteria, deployment architecture, etc. The more, the better. * It covers a real-world ML system that is used in production. * It describes one particular ML use case. There are only a few exceptions that detail multiple ML projects at once -- about causal ML or generative AI, for example. Did we miss some great ML case studies? Let us know! Our Discord Community with 2000+ ML practitioners is the best place to share feedback. Get started with open-source ML monitoring Evaluate, test, and monitor ML models in production with Evidently. From tabular data to NLP and LLM. Built for data scientists and ML engineers. HEAD TO DOCSGITHUB By clicking "Accept", you agree to the storing of cookies on your device to enhance site navigation, analyze site usage, and assist in our marketing efforts. View our Privacy Policy for more information. DenyAccept Privacy Preferences Essential cookies Required Marketing cookies [ ]Essential Personalization cookies [ ]Essential Analytics cookies [ ]Essential Reject all cookiesAllow all cookiesSave preferences Sign up for our monthly "ML in production" newsletter. [ ][Sign up] Thank you! Your submission has been received! Oops! Something went wrong while submitting the form. Evidently AI logo Evidently on TwitterEvidently on LinkedInEvidently on YouTube Evidently Discord community[65] Product Open-source OverviewReportsTest SuitesML MonitoringData QualityData DriftML Model PerformanceNLP and LLM Enterprise Evidently Cloud Learn Resources BlogTutorialsGuides Special projects ML platformsML use cases MLOps course ML observability course PricingDocsGitHubCommunity (c) 2023 Evidently AI Privacy policyTerms of service Sign up for our monthly "ML in production" newsletter. [ ][Sign up] Thank you! Your submission has been received! Oops! Something went wrong while submitting the form. Evidently AI logo Evidently on TwitterEvidently on LinkedInEvidently on YouTube Evidently Discord community[65] Product Open-source OverviewReportsTest SuitesML MonitoringData QualityData DriftML Model PerformanceNLP and LLM Open-source Evidently Cloud Learn Resources BlogTutorialsGuides Special projects ML platformsML use cases MLOps course ML observability course PricingDocsGitHubCommunity (c) 2023 Evidently AI Privacy policyTerms of service Sign up for our monthly "ML in production" newsletter. [ ][Sign up] Thank you! Your submission has been received! Oops! Something went wrong while submitting the form. Evidently AI logo Evidently on TwitterEvidently on LinkedInEvidently on YouTube Evidently Discord community[65] Product Open-source OverviewReportsTest SuitesML MonitoringData QualityData DriftML Model PerformanceNLP and LLM Enterprise Evidently Cloud Learn Resources BlogTutorialsGuides Special projects ML platformsML use cases MLOps course ML observability course PricingDocsGitHubCommunity (c) 2023 Evidently AI Privacy policyTerms of service