https://github.com/kedro-org/kedro Skip to content Sign up * Why GitHub? + Features + Mobile + Actions + Codespaces + Packages + Security + Code review + Issues + Integrations + GitHub Sponsors + Customer stories * Team * Enterprise * Explore + Explore GitHub + Learn and contribute + Topics + Collections + Trending + Learning Lab + Open source guides + Connect with others + The ReadME Project + Events + Community forum + GitHub Education + GitHub Stars program * Marketplace * Pricing + Plans + Compare plans + Contact Sales + Education [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this organization All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} kedro-org / kedro Public * Notifications * Fork 558 * Star 5.3k * A Python framework for creating reproducible, maintainable and modular data science code. kedro.readthedocs.io/ Apache-2.0 License 5.3k stars 558 forks Star Notifications * Code * Issues 39 * Pull requests 16 * Discussions * Security * Insights More * Code * Issues * Pull requests * Discussions * Security * Insights main Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default View all tags 20 branches 28 tags Code Latest commit @SajidAlamQB SajidAlamQB [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... ... b9fba67 Jan 21, 2022 [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... ...long any more (#1161) * removed appropriate references to QuantumBlack * Update 07_set_up_experiment_tracking.md * changes based on reviews * removing qb emails for git config b9fba67 Git stats * 1,406 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time .circleci [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... Jan 21, 2022 .github Update github URLs to kedro-org (#1145) Jan 12, 2022 docs [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... Jan 21, 2022 features [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... Jan 21, 2022 kedro [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... Jan 21, 2022 static APIDataSet ease of use changes to auth interactions (#1105) Dec 17, 2021 tests [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... Jan 21, 2022 tools Update CircleCI config to use public docker images (#1171) Jan 21, 2022 .gitignore Ignore .envrc for framework (#872) Sep 9, 2021 .pre-commit-config.yaml Fix pylint complaints after pylint release (#1072) Nov 26, 2021 .readthedocs.yml [KED-1596] Docs format - restrict to just pdf to see if readthedocs b... May 14, 2020 CITATION.cff Update github URLs to kedro-org (#1145) Jan 12, 2022 CODEOWNERS Update CODEOWNERS and README to highlight the current core Kedro team (... Mar 10, 2020 CODE_OF_CONDUCT.md [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... Jan 21, 2022 CONTRIBUTING.md Update github URLs to kedro-org (#1145) Jan 12, 2022 LICENSE.md Revert to GitHub Apache 2.0 license template (#1287) Nov 4, 2021 MANIFEST.in [KED-2912] Remove McK headers + Licence from codebase + docs (#1285) Nov 1, 2021 Makefile [KED-2961] Tidy CircleCI config (#1102) Dec 16, 2021 README.md Update github URLs to kedro-org (#1145) Jan 12, 2022 RELEASE.md [KED-2419] Make pipeline and Pipeline consistent, take 2 (#1147) Jan 18, 2022 behave.ini First commit of version 0.14 May 16, 2019 pyproject.toml [KED-2508] Reduce config footprint (#1275) Oct 25, 2021 requirements.txt [KED-2900] Bump Rope from 0.19.0 to 0.21.0 moving to a more permissiv... Oct 26, 2021 setup.py [KED-3046] Remove "QuantumBlack Labs" from places where it doesn't be... Jan 21, 2022 test_requirements.txt Pin pytables to match version installed through conda (#1139) Jan 7, 2022 trufflehog-ignore.txt [KED-2634] Update architecture diagram (#1177) Jul 1, 2021 View code [ ] What is Kedro? How do I install Kedro? What are the main features of Kedro? How do I use Kedro? Why does Kedro exist? The humans behind Kedro Can I contribute? Where can I learn more? Who likes Kedro? How can I cite Kedro? README.md Kedro Logo Banner Python version PyPI version Conda version License Discord Server CircleCI - Main Branch Develop Branch Build Documentation What is Kedro? Kedro is an open-source Python framework for creating reproducible, maintainable and modular data science code. It borrows concepts from software engineering and applies them to machine-learning code; applied concepts include modularity, separation of concerns and versioning. How do I install Kedro? To install Kedro from the Python Package Index (PyPI) simply run: pip install kedro It is also possible to install Kedro using conda: conda install -c conda-forge kedro Our Get Started guide contains full installation instructions, and includes how to set up Python virtual environments. What are the main features of Kedro? Kedro-Viz Pipeline Visualisation A pipeline visualisation generated using Kedro-Viz Feature What is this? Project A standard, modifiable and easy-to-use project template Template based on Cookiecutter Data Science. A series of lightweight data connectors used to save and Data load data across many different file formats and file Catalog systems, including local and network file systems, cloud object stores, and HDFS. The Data Catalog also includes data and model versioning for file-based systems. Pipeline Automatic resolution of dependencies between pure Python Abstraction functions and data pipeline visualisation using Kedro-Viz . Test-driven development using pytest, produce Coding well-documented code using Sphinx, create linted code Standards with support for flake8, isort and black and make use of the standard Python logging library. Deployment strategies that include single or Flexible distributed-machine deployment as well as additional Deployment support for deploying on Argo, Prefect, Kubeflow, AWS Batch and Databricks. How do I use Kedro? The Kedro documentation includes three examples to help get you started: * A typical "Hello World" example, for an entry-level description of the main Kedro concepts * An introduction to the project template using the Iris dataset * A more detailed spaceflights tutorial to give you hands-on experience Why does Kedro exist? Kedro is built upon our collective best-practice (and mistakes) trying to deliver real-world ML applications that have vast amounts of raw unvetted data. We developed Kedro to achieve the following: * To address the main shortcomings of Jupyter notebooks, one-off scripts, and glue-code because there is a focus on creating maintainable data science code * To enhance team collaboration when different team members have varied exposure to software engineering concepts * To increase efficiency, because applied concepts like modularity and separation of concerns inspire the creation of reusable analytics code The humans behind Kedro Kedro is maintained by a product team and a number of contributors from across the world. Can I contribute? Yes! Want to help build Kedro? Check out our guide to contributing to Kedro. Where can I learn more? There is a growing community around Kedro. Have a look at the Kedro FAQs to find projects using Kedro and links to articles, podcasts and talks. Who likes Kedro? There are Kedro users across the world, who work at start-ups, major enterprises and academic institutions like Absa, Acensi, Advanced Programming Solutions SL, AI Singapore, Augment Partners, AXA UK, Belfius, Beamery, Caterpillar, CRIM, Dendra Systems, Element AI, GetInData, GMO, Indicium, Imperial College London, ING, Jungle Scout, Helvetas, Leapfrog, McKinsey & Company, Mercado Libre Argentina, Modec, Mosaic Data Science, NaranjaX, NASA, Open Data Science LatAm, Prediqt, QuantumBlack, Retrieva, Roche, Sber, Societe Generale, Telkomsel, Universidad Rey Juan Carlos, UrbanLogiq, Wildlife Studios, WovenLight and XP. Kedro has also won Best Technical Tool or Framework for AI in the 2019 Awards AI competition and a merit award for the 2020 UK Technical Communication Awards. It is listed on the 2020 ThoughtWorks Technology Radar and the 2020 Data & AI Landscape. How can I cite Kedro? If you're an academic, Kedro can also help you, for example, as a tool to solve the problem of reproducible research. Use the "Cite this repository" button on our repository to generate a citation from the CITATION.cff file. About A Python framework for creating reproducible, maintainable and modular data science code. kedro.readthedocs.io/ Topics python pipeline pipelines-as-code hacktoberfest data-versioning mlops kedro experiment-tracking Resources Readme License Apache-2.0 License Code of conduct Code of conduct Stars 5.3k stars Watchers 90 watching Forks 558 forks Releases 28 0.17.6 Latest Dec 9, 2021 + 27 releases Used by 657 * @kedro-org * @wafaesbh * @deutheros * @hamzajuzer10 * @mmdata * @kosmos * @PanchenkoYehor * @rick-62 + 649 Contributors 127 * @lorenabalan * @921kiyo * @limdauto * @andrii-ivaniuk * @DmitriiDeriabinQB * @yetudada * @deepyaman * @mzjp2 * @MerelTheisenQB * @AntonyMilneQB * @idanov + 116 contributors Languages * Python 98.5% * Other 1.5% * (c) 2022 GitHub, Inc. * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.