https://github.com/360er0/awesome-lego-machine-learning Skip to content Toggle navigation Sign up * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code + Explore + All features + Documentation + GitHub Skills + Blog * Solutions + For + Enterprise + Teams + Startups + Education + By Solution + CI/CD & Automation + DevOps + DevSecOps + Case Studies + Customer Stories + Resources * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles + Repositories + Topics + Trending + Collections * Pricing [ ] * # In this repository All GitHub | Jump to | * No suggested jump to results * # In this repository All GitHub | Jump to | * # In this user All GitHub | Jump to | * # In this repository All GitHub | Jump to | Sign in Sign up {{ message }} 360er0 / awesome-lego-machine-learning Public * Notifications * Fork 2 * Star 106 106 stars 2 forks Star Notifications * Code * Issues 1 * Pull requests 0 * Actions * Projects 0 * Security * Insights More * Code * Issues * Pull requests * Actions * Projects * Security * Insights 360er0/awesome-lego-machine-learning This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. main Switch branches/tags [ ] Branches Tags Could not load branches Nothing to show {{ refName }} default View all branches Could not load tags Nothing to show {{ refName }} default View all tags Name already in use A tag already exists with the provided branch name. Many Git commands accept both tag and branch names, so creating this branch may cause unexpected behavior. Are you sure you want to create this branch? Cancel Create 1 branch 0 tags Code * Local * Codespaces * Clone HTTPS GitHub CLI [https://github.com/3] Use Git or checkout with SVN using the web URL. [gh repo clone 360er0] Work fast with our official CLI. Learn more. * Open with GitHub Desktop * Download ZIP Sign In Required Please sign in to use Codespaces. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching GitHub Desktop If nothing happens, download GitHub Desktop and try again. Launching Xcode If nothing happens, download Xcode and try again. Launching Visual Studio Code Your codespace will open once ready. There was a problem preparing your codespace, please try again. Latest commit @360er0 360er0 Update README.md ... 157310b Dec 2, 2022 Update README.md 157310b Git stats * 7 commits Files Permalink Failed to load latest commit information. Type Name Latest commit message Commit time README.md Update README.md Dec 2, 2022 View code [ ] Awesome LEGO Machine Learning Parts Classification Applications Sorting Machines Code Papers Datasets Rendering Parts Understanding Part Ids Generating Sets Papers Datasets Assembling Sets Papers ML at LEGO Group Other lists README.md Awesome LEGO Machine Learning A curated list of resources dedicated to Machine Learning applications to LEGO bricks. Parts Classification Applications * Brickognize [2022.12] - Web application which recognizes any Lego part or set. * BrickMonkey[2022.11] - Mobile application to recognize minifig torsos. * RebrickNet [2022.01] - Web application on rebrickable.com. Currently, it detects and recognizes 300 different parts and an unspecified number of colors. Train using real videos and photos submitted by users. * Minifig Finder [2021.12] - Web application for minifig identification. Uses Mask R-CNN for detecting individual parts (head, torso, and legs) and metric learning for classification. Currently, it looks abandoned and not working. * Unnamed mobile app [2021.10], Update 1 [2021.11], Update 2 [2021.12] - Unnamed and unreleased mobile app. Uses LDraw renders for training a classifier. The first version recognized only six different parts. * Brickit [2021.07] - Mobile application for detecting parts and suggesting models which can be built from those parts. * Brickly [2021.04] - Unfinished and unreleased app for part detection and identifiction. * Instabrick, Kickstarter [2019.10], Review [2021.04] - Camera and web application for part identification and inventory. Sorting Machines * Universal LEGO Sorting Machine [2022.06] - * The World's First Universal LEGO Sorting Machine [2019.12], Classifier [2019.12], Dataset [2019.03], CV Pipeline [2019.08] - Sorting machine built by Daniel West. * Lego Sorter using TensorFlow on Raspberry Pi [2018.09] - Sorting machine that recognizes 11 different parts. * Automatic Lego Sorting Machine - Students' report containing the design of the sorting machine. Mostly related to the mechanical side of the machine. * Sorting 2 Metric Tons of Lego [2017.04], Software Side [2017.05] - One of the first publically described sorter that uses ML for part classification. Code * Lego Brick Recognition [2020.03] - Code for generating synthetic dataset and training a classifier for 15 different parts. Papers * How to sort them? A network for LEGO bricks classification [2022.07] - The paper presents a comparison of 28 models used for image classification trained to recognize 447 different LEGO bricks. * Hierarchical 2-step neural-based LEGO bricks detection and labeling [2021.04] - The paper proposes two-step system for identifying LEGO bricks -- detection and classification. The model is limited to recognizing only 10 different parts. * Lego Recognition Tool [2018.03] - The diploma thesis that describes the process to develop a machine, which is capable of identifying Lego bricks and sorting them into boxes. Datasets * Video of LEGO bricks on conveyor belt [2022.01] - The dataset contains videos of LEGO bricks moving on a white conveyor belt to train a classifier for sorting machine. * B200C LEGO Classification Dataset [2021.08], Code - Dataset for parts classification. It contains 800k high-quality renders for 200 different parts. * LEGO bricks for training classification network [2021.06] - The dataset part classification. It contains images of 447 different parts, both real photos (52k) and renders (567k). * Tagged images with LEGO bricks [2021.02] - The dataset for parts detection. It contains 2933 photos and 2908 renders annotated with bounding boxes. It doesn't include information about part ids. * Lego Brick Sorting [2018.12] - The dataset for parts classification. It contains 4,580 photos of 20 different parts. * Lego vs. Generic Brick [2018.12] - The dataset for recognizing original vs fake bricks. It contains 12 classes across 6 brick types, and more than 20k images taken by 4 cameras. Rendering Parts * Rendering LDraw Parts Images for Rebrickable [2018.10] - Comprehensive guide describing how Rebrickable rendered their images. * Lego multi object detection [2021.11] - Script to generate renders of LEGO parts and corresponding bounding boxes. Uses Python and Blender. * BrickRegistration [2021.11] - A tool to generate synthetic 3d scenes with LEGO parts and their segmentation information. * Lego Renderer for ML Projects [2020.01] - A set of Python scripts /Blender utilities for rendering Lego scenes for use in deep learning/computer vision projects. Includes a basic scene with a tracked camera, scripts for rendering images, normals, masks of Lego combinations, and utilities for recording the positions of special features on different pieces (studs, corners, holes) easily. Understanding Part Ids * Understanding LEGO part numbers [2020.10] * Let's talk about classification of parts * LDraw Part Number Specification * Bricklink Item Numbers Generating Sets Papers * Brick Yourself within 3 Minutes [2022.05] - Given the input portrait, it uses several deep neural networks to extract the attributes to describe the human appearance shown in the image. Built on these attributes, the model generates the corresponding uncolored brick model by iteratively searching for brick components with the coordinate descent algorithm. Finally, it assigns a color to every brick to get the final brick model. * Image2Lego: Customized LEGO(r) Set Generation from Images [2021.08] - The system takes an image as an input, encodes it as embedding, generates a voxelized 3D model, and finally convert it into LEGO bricks. The model jointly trains a 3D model autoencoder and a 2D-to-3D encoder. * Automatic Generation of Vivid LEGO Architectural Sculptures [2019] - It introduces an automatic system to convert an architectural model into a LEGO sculpture while preserving the original model's shape features like repeating components, shape details and planarity. * Legolization: Optimizing LEGO Designs [2015] - It converts a 3D model into a voxelized 3D model, and then into LEGO bricks. The paper focuses on optimizing the physical stability of the generated design. * Survey on Automated LEGO Assembly Construction [2014] - The survey paper on converting 3D models into LEGO models. Datasets * Lego sets made in LDraw - Links to over 2000 LEGO sets recreated in LDraw. * LDraw Official Model Repository - LDraw repository of over 1800 official LEGO sets. * BrickHub - Almost 500 original and custom sets. Assembling Sets Papers * Planning Assembly Sequence with Graph Transformer [2022.10] - A graph-transformer based framework for ASP problem, with a heterogeneous graph attention network to encoder the models, which are decoded with the attention mechanism to generate assembly sequence. * Translating a Visual LEGO Manual to a Machine-Executable Plan [2022.07] - Understanding the assembly process using manual. * Break and Make: Interactive Structural Understanding Using LEGO Bricks [2022.07] - Introduction of a new task for visual understanding, 3D simulator to manipulate LEGO models, and a model to solve the proposed task of recreating the LEGO model. * Building LEGO Using Deep Generative Models of Graphs [2020.12] - It proposes a way to represent the LEGO model as graphs and learn how to generate them step-by-step. ML at LEGO Group * Building Blocks of Machine Learning at LEGO with Francesc Joan Riera [2021.11] - Podcast about using ML at LEGO. In particular, their ML infrastructure, content moderation system, and classifying images of LEGO models into thematical categories. Other lists * Awesome LEGO - General list of LEGO resources. About No description or website provided. Topics machine-learning awesome-list lego Resources Readme Stars 106 stars Watchers 2 watching Forks 2 forks Releases No releases published Packages 0 No packages published Footer (c) 2022 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact GitHub * Pricing * API * Training * Blog * About You can't perform that action at this time. You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session.