https://github.com/DAGWorks-Inc/hamilton/tree/main/ui Skip to content Navigation Menu Toggle navigation Sign in * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code Explore + All features + Documentation + GitHub Skills + Blog * Solutions For + Enterprise + Teams + Startups + Education By Solution + CI/CD & Automation + DevOps + DevSecOps Resources + Learning Pathways + White papers, Ebooks, Webinars + Customer Stories + Partners * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles Repositories + Topics + Trending + Collections * Pricing Search or jump to... Search code, repositories, users, issues, pull requests... Search [ ] Clear Search syntax tips Provide feedback We read every piece of feedback, and take your input very seriously. [ ] [ ] Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Name [ ] Query [ ] To see all available qualifiers, see our documentation. Cancel Create saved search Sign in Sign up You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} DAGWorks-Inc / hamilton Public * Notifications * Fork 84 * Star 1.3k * * Code * Issues 97 * Pull requests 26 * Discussions * Actions * Projects 0 * Security * Insights Additional navigation options * Code * Issues * Pull requests * Discussions * Actions * Projects * Security * Insights Files main Breadcrumbs 1. hamilton / ui / Directory actions [ ] More options Directory actions More options Latest commit History History main Breadcrumbs 1. hamilton / ui / Top Folders and files Last Last Name Name commit commit message date parent directory .. backend/server backend/server deployment deployment frontend frontend screenshots screenshots sdk sdk .gitignore .gitignore README.md README.md hamilton-ui-architecture.png hamilton-ui-architecture.png View all files README.md Hamilton UI This contains the code for the new Hamilton UI. For an overview of getting started & features see this documentation. For a lengthier post and intro see our blog post. One operational UI for all your dataflows The Hamilton UI is a system that provides the following capabilities: 1. Execution tracking with associated metadata + Provides a persistent database to store/manage these + Provides a server that allows reading/writing/authentication 2. Data/artifact observability: provides telemetry/observability of Hamilton executions + specific function results/code through a web interface 3. Lineage & provenance: allows you to quickly inspect how code and data is connected. 4. Catalog: everything is observed and cataloged, so you can quickly search and find what exists and when it was run. The UI is meant to monitor/debug Hamilton dataflows both in development and production. The aim is to enable dataflow authors to move faster during all phases of the software development lifecycle. For an overview of some of these features you can watch this quick video. Execution Tracking Description1 Description2 Description3 See what's slow (left), pinpoint errors (middle) compare execution performance (right) Data/Artifact Observability Description3 Description2 Description1 Visualize data for a run (left), track code the run used (middle) compare data across executions (right) Lineage & Provenance Description3 Description2 See how things connect: what's upstream/downstream (left), walk through code visually (right) Catalog Description3 Description2 Understand artifacts produced (left), find features and when they were used (right) Getting started You can watch this video walkthrough on getting set up. Make sure you have docker running: # clone the repository if you haven't git clone https://github.com/dagworks-inc/hamilton # change into the UI directory cd hamilton/ui # run docker ./deployment/run.sh Once docker is running navigate to http://localhost:8242 and create an email and a project; then follow instructions on integrating with Hamilton. A fuller guide can be found here. Architecture The architecture is simple. architecture-diagram The tracking server stores data on postgres, as well as any blobs on s3. This is stored in a docker volume on local mode. The frontend is a simple React application. There are a few authentication/ACL capabilities, but the default is to use local/unauthenticated (open). Please talk to us if you have a need for more custom authentication. License There are a few directories that are not licensed under the BSD-3 Clear Clause license. These are: * frontend/src/ee * backend/server/trackingserver_auth See the main repository LICENSE for details, else the LICENSE file in the respective directories mentioned above. Footer (c) 2024 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact * Manage cookies * Do not share my personal information You can't perform that action at this time.