https://github.com/ploomber/ploomber Skip to content Sign up * Why GitHub? + Features + Mobile + Actions + Codespaces + Packages + Security + Code review + Issues + Integrations + GitHub Sponsors + Customer stories * Team * Enterprise * Explore + Explore GitHub + Learn and contribute + Topics + Collections + Trending + Learning Lab + Open source guides + Connect with others + The ReadME Project + Events + Community forum + GitHub Education + GitHub Stars program * Marketplace * Pricing + Plans + Compare plans + Contact Sales + Education [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this organization All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} ploomber / ploomber Public * Notifications * Fork 78 * Star 1.1k * The fastest [?][?] way to build data pipelines. Develop iteratively, deploy anywhere. [?] ploomber.io Apache-2.0 License 1.1k stars 78 forks Star Notifications * Code * Issues 126 * Pull requests 3 * Actions * Projects 0 * Wiki * Security * Insights More * Code * Issues * Pull requests * Actions * Projects * Wiki * Security * Insights This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. master Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default View all tags 11 branches 71 tags Code Latest commit @edublancas edublancas readme edits ... e123d3d Feb 3, 2022 readme edits e123d3d Git stats * 2,357 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time .githooks minor git-hook updates, documents command Oct 19, 2021 .github/workflows fixes windows ci Jan 14, 2022 _static Improved onboarding process (#528) Feb 3, 2022 doc Improved onboarding process (#528) Feb 3, 2022 jupyter-config task_class_from_source_str uses lazy load to determine if a dotted pa... Jul 30, 2021 src/ploomber Bumps up ploomber to version 0.15.1dev Feb 3, 2022 tests closes #508 Feb 3, 2022 .coveragerc updates coveragerc config Jan 16, 2021 .gitignore Update .gittignore to exclude .idea/ (#451) Dec 26, 2021 ARCHITECTURE.md Clarify paragraph about MetaProduct (#343) Sep 29, 2021 CHANGELOG.md Bumps up ploomber to version 0.15.1dev Feb 3, 2022 CONTRIBUTING.md conda-forge note and missing cd command (#516) Jan 31, 2022 LICENSE Update LICENSE Jan 29, 2022 MANIFEST.in fixes to "ploomber scaffold" and "ploomber install" May 9, 2021 README.md readme edits Feb 3, 2022 pyproject.toml updates pyproject.toml Jan 3, 2022 readthedocs.yaml fixes readthedocs build May 18, 2021 setup.cfg updates contributing guide Oct 15, 2021 setup.py fixes README.md read on windows Jan 24, 2022 tasks.py minor git-hook updates, documents command Oct 19, 2021 View code [ ] Installation Getting started Community Main Features [?][?] Get started quickly [?] Shorter development cycles [?] Deploy anywhere Automated migration from legacy notebooks Resources README.md [logo] CI Linux CI macOS CI Windows Documentation Status PyPI Conda (channel only) Conda Coverage Twitter Binder Downloads Join our community | Newsletter | Contact us | Docs | Blog | Website | YouTube Ploomber is the fastest way to build data pipelines [?][?]. Use your favorite editor (Jupyter, VSCode, PyCharm) to develop interactively and deploy [?] without code changes (Kubernetes, Airflow, AWS Batch, and SLURM). Do you have legacy notebooks? Refactor them into modular pipelines with a single command. Get Started Installation Compatible with Python 3.6 and higher. Install with pip: pip install ploomber Or with conda: conda install ploomber -c conda-forge Getting started Open a hosted JupyterLab instance: image Run an example locally: # ML pipeline example ploomber examples -n templates/ml-basic -o ml-basic cd ml-basic # install dependencies pip install -r requirements.txt # run pipeline ploomber build You just ran a Ploomber pipeline! Check out the output folder, you'll see an HTML report with model results! The pipeline.yaml contains the pipeline declaration. Feel free to modify any of the tasks, then call ploomber build again to update the results (Note: if using VSCode or PyCharm, execute ploomber nb -i before editing the files). What's next? Ready to migrate your project? Click here. Do you want to learn more? Check out the introductory tutorial. Run more examples. Community * Join us on Slack * Newsletter * YouTube * Contact the development team Main Features [?][?] Get started quickly A simple YAML API to get started quickly, a powerful Python API for total flexibility. get-started.mp4 [?] Shorter development cycles Automatically cache your pipeline's previous results and only re-compute tasks that have changed since your last execution. shorter-cycles.mp4 [?] Deploy anywhere Run as a shell script in a single machine or distributively in Kubernetes, Airflow, AWS Batch, or SLURM. deploy.mp4 Automated migration from legacy notebooks Bring your old monolithic notebooks, and we'll automatically convert them into maintainable, modular pipelines. refactor.mp4 I want to migrate my notebook. Show me a demo. Resources * Documentation * PyData Chicago talk (covers motivation and demo) * Develop and deploy an ML pipeline in 30 minutes (EuroPython 2021) * Guest blog post on the official Jupyter blog * Examples (Machine Learning pipeline, ETL, among others) * Blog * Comparison with other tools * More videos About The fastest [?][?] way to build data pipelines. Develop iteratively, deploy anywhere. [?] ploomber.io Topics workflow data-science machine-learning jupyter vscode pipelines data-engineering pycharm jupyter-notebooks papermill mlops Resources Readme License Apache-2.0 License Stars 1.1k stars Watchers 15 watching Forks 78 forks Releases 71 tags Used by 24 * @lgfunderburk * @ideaconsult * @bnbbdz * @mat-ej * @koroltim * @bhundt * @magalimorin18 * @marcoboucas + 16 Contributors 23 * @edublancas * @idomic * @fferegrino * @rehman000 * @jennifertieuu * @arturomf94 * @Raj-Pansuriya * @bibhashthakur * @abhishak3 * @maticortesr * @jayeclark + 12 contributors Languages * Python 98.4% * HTML 1.5% * Other 0.1% * (c) 2022 GitHub, Inc. * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.