https://github.com/AiuniAI/Unique3D Skip to content Navigation Menu Toggle navigation Sign in * Product + Actions Automate any workflow + Packages Host and manage packages + Security Find and fix vulnerabilities + Codespaces Instant dev environments + GitHub Copilot Write better code with AI + Code review Manage code changes + Issues Plan and track work + Discussions Collaborate outside of code Explore + All features + Documentation + GitHub Skills + Blog * Solutions For + Enterprise + Teams + Startups + Education By Solution + CI/CD & Automation + DevOps + DevSecOps Resources + Learning Pathways + White papers, Ebooks, Webinars + Customer Stories + Partners * Open Source + GitHub Sponsors Fund open source developers + The ReadME Project GitHub community articles Repositories + Topics + Trending + Collections * Enterprise + Enterprise platform AI-powered developer platform Available add-ons + Advanced Security Enterprise-grade security features + GitHub Copilot Enterprise-grade AI features + Premium Support Enterprise-grade 24/7 support * Pricing Search or jump to... Search code, repositories, users, issues, pull requests... Search [ ] Clear Search syntax tips Provide feedback We read every piece of feedback, and take your input very seriously. [ ] [ ] Include my email address so I can be contacted Cancel Submit feedback Saved searches Use saved searches to filter your results more quickly Name [ ] Query [ ] To see all available qualifiers, see our documentation. Cancel Create saved search Sign in Sign up You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} AiuniAI / Unique3D Public * Notifications You must be signed in to change notification settings * Fork 61 * Star 764 * Official implementation of Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image wukailu.github.io/unique3d/ License MIT license 764 stars 61 forks Branches Tags Activity Star Notifications You must be signed in to change notification settings * Code * Issues 17 * Pull requests 1 * Actions * Projects 0 * Security * Insights Additional navigation options * Code * Issues * Pull requests * Actions * Projects * Security * Insights AiuniAI/Unique3D This commit does not belong to any branch on this repository, and may belong to a fork outside of the repository. main BranchesTags Go to file Code Folders and files Last Last Name Name commit commit message date Latest commit History 47 Commits app app assets assets custum_3d_diffusion custum_3d_diffusion mesh_reconstruction mesh_reconstruction scripts scripts .editorconfig .editorconfig .gitignore .gitignore LICENSE LICENSE README.md README.md README_jp.md README_jp.md README_zh.md README_zh.md gradio_app.py gradio_app.py install_windows_win_py311_cu121.bat install_windows_win_py311_cu121.bat requirements-detail.txt requirements-detail.txt requirements-win-py311-cu121.txt requirements-win-py311-cu121.txt requirements.txt requirements.txt View all files Repository files navigation * README * MIT license Zhong Wen Ban Ben Ri Ben Yu Ban Unique3D Official implementation of Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image. Kailu Wu, Fangfu Liu, Zhihan Cai, Runjie Yan, Hanyang Wang, Yating Hu, Yueqi Duan, Kaisheng Ma Paper | Project page | Huggingface Demo | Gradio Demo | Online Demo * Demo inference speed: Gradio Demo > Huggingface Demo > Huggingface Demo2 > Online Demo If the Gradio Demo unfortunately hangs or is very crowded, you can use the Online Demo aiuni.ai, which is free to try (get the registration invitation code Join Discord: https://discord.gg/aiuni). However, the Online Demo is slightly different from the Gradio Demo, in that the inference speed is slower, and the generation results is less stable, but the quality of the material is better. [teaser_saf] High-fidelity and diverse textured meshes generated by Unique3D from single-view wild images in 30 seconds. More features The repo is still being under construction, thanks for your patience. * [*] Upload weights. * [*] Local gradio demo. * [ ] Detailed tutorial. * [*] Huggingface demo. * [ ] Detailed local demo. * [*] Comfyui support. * [*] Windows support. * [ ] Docker support. * [ ] More stable reconstruction with normal. * [ ] Training code release. Preparation for inference Linux System Setup. Adapted for Ubuntu 22.04.4 LTS and CUDA 12.1. conda create -n unique3d python=3.11 conda activate unique3d pip install ninja pip install diffusers==0.27.2 pip install mmcv-full -f https://download.openmmlab.com/mmcv/dist/cu121/torch2.3.1/index.html pip install -r requirements.txt oak-barry provide another setup script for torch210+cu121 at here. Windows Setup. * Thank you very much jtydhr88 for the windows installation method! See issues/15. According to issues/15, implemented a bat script to run the commands, so you can: 1. Might still require Visual Studio Build Tools, you can find it from Visual Studio Build Tools. 2. Create conda env and activate it 1. conda create -n unique3d-py311 python=3.11 2. conda activate unique3d-py311 3. download triton whl for py311, and put it into this project. 4. run install_windows_win_py311_cu121.bat 5. answer y while asking you uninstall onnxruntime and onnxruntime-gpu 6. create the output folder tmp\gradio under the driver root, such as F:\tmp\gradio for me. 7. python app/gradio_local.py --port 7860 More details prefer to issues/15. Interactive inference: run your local gradio demo. 1. Download the weights from huggingface spaces or Tsinghua Cloud Drive, and extract it to ckpt/*. Unique3D +--ckpt +-- controlnet-tile/ +-- image2normal/ +-- img2mvimg/ +-- realesrgan-x4.onnx +-- v1-inference.yaml 2. Run the interactive inference locally. python app/gradio_local.py --port 7860 ComfyUI Support Thanks for the ComfyUI-Unique3D implementation from jtydhr88! Tips to get better results 1. Unique3D is sensitive to the facing direction of input images. Due to the distribution of the training data, orthographic front-facing images with a rest pose always lead to good reconstructions. 2. Images with occlusions will cause worse reconstructions, since four views cannot cover the complete object. Images with fewer occlusions lead to better results. 3. Pass an image with as high a resolution as possible to the input when resolution is a factor. Acknowledgement We have intensively borrowed code from the following repositories. Many thanks to the authors for sharing their code. * Stable Diffusion * Wonder3d * Zero123Plus * Continues Remeshing * Depth from Normals Collaborations Our mission is to create a 4D generative model with 3D concepts. This is just our first step, and the road ahead is still long, but we are confident. We warmly invite you to join the discussion and explore potential collaborations in any capacity. If you're interested in connecting or partnering with us, please don't hesitate to reach out via email (wkl22@mails.tsinghua.edu.cn). * Follow us on twitter for the latest updates: https://x.com/ aiuni_ai * Join AIGC 3D/4D generation community on discord: https:// discord.gg/aiuni * Research collaboration, please contact: ai@aiuni.ai Citation If you found Unique3D helpful, please cite our report: @misc{wu2024unique3d, title={Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image}, author={Kailu Wu and Fangfu Liu and Zhihan Cai and Runjie Yan and Hanyang Wang and Yating Hu and Yueqi Duan and Kaisheng Ma}, year={2024}, eprint={2405.20343}, archivePrefix={arXiv}, primaryClass={cs.CV} } About Official implementation of Unique3D: High-Quality and Efficient 3D Mesh Generation from a Single Image wukailu.github.io/Unique3D/ Topics image-to-3d aigc 3d-aigc Resources Readme License MIT license Activity Custom properties Stars 764 stars Watchers 20 watching Forks 61 forks Report repository Releases No releases published Packages 0 No packages published Contributors 6 * @wukailu * @liuff19 * @AprilAVAR * @Limbicnation * @eltociear * @jtydhr88 Languages * Python 99.6% * Batchfile 0.4% Footer (c) 2024 GitHub, Inc. Footer navigation * Terms * Privacy * Security * Status * Docs * Contact * Manage cookies * Do not share my personal information You can't perform that action at this time.