https://spectrum.ieee.org/drone-quadrotor [ ] IEEE.orgIEEE Xplore Digital LibraryIEEE StandardsMore Sites Sign InJoin IEEE "Inspiring Technology: 34 Breakthroughs": Download IEEE's 140th anniversary book for FREE. Learn More - Close bar Tiny Quadrotor Learns to Fly in 18 Seconds Share FOR THE TECHNOLOGY INSIDER Search: [ ] Explore by topic AerospaceArtificial IntelligenceBiomedicalClimate TechComputing Consumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductors TelecommunicationsTransportation IEEE Spectrum FOR THE TECHNOLOGY INSIDER Topics AerospaceArtificial IntelligenceBiomedicalClimate TechComputing Consumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductors TelecommunicationsTransportation Sections FeaturesNewsOpinionCareersDIYEngineering Resources More NewslettersPodcastsSpecial ReportsCollectionsExplainersTop Programming LanguagesRobots Guide /IEEE Job Site / For IEEE Members Current IssueMagazine ArchiveThe InstituteThe Institute Archive For IEEE Members Current IssueMagazine ArchiveThe InstituteThe Institute Archive IEEE Spectrum About UsContact UsReprints & Permissions /Advertising / Follow IEEE Spectrum Support IEEE Spectrum IEEE Spectrum is the flagship publication of the IEEE -- the world's largest professional organization devoted to engineering and applied sciences. Our articles, podcasts, and infographics inform our readers about developments in technology, engineering, and science. Join IEEE Subscribe About IEEEContact & SupportAccessibilityNondiscrimination PolicyTerms IEEE Privacy PolicyCookie Preferences (c) Copyright 2024 IEEE -- All rights reserved. A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. Enjoy more free content and benefits by creating an account Saving articles to read later requires an IEEE Spectrum account The Institute content is only available for members Downloading full PDF issues is exclusive for IEEE Members Downloading this e-book is exclusive for IEEE Members Access to Spectrum 's Digital Edition is exclusive for IEEE Members Following topics is a feature exclusive for IEEE Members Adding your response to an article requires an IEEE Spectrum account Create an account to access more content and features on IEEE Spectrum , including the ability to save articles to read later, download Spectrum Collections, and participate in conversations with readers and editors. For more exclusive content and features, consider Joining IEEE . Join the world's largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum's articles, archives, PDF downloads, and other benefits. Learn more - Join the world's largest professional organization devoted to engineering and applied sciences and get access to this e-book plus all of IEEE Spectrum's articles, archives, PDF downloads, and other benefits. Learn more - CREATE AN ACCOUNTSIGN IN JOIN IEEESIGN IN Close Access Thousands of Articles -- Completely Free Create an account and get exclusive content and features: Save articles, download collections, and talk to tech insiders -- all free! For full access and benefits, join IEEE as a paying member. CREATE AN ACCOUNTSIGN IN RoboticsArtificial IntelligenceTypeNews Tiny Quadrotor Learns to Fly in 18 Seconds NYU and TII researchers get robots into the air with fast simulations on a consumer laptop Evan Ackerman 08 Feb 2024 3 min read A short GIF of simulated X-shaped devices scrambling around until they gradually settle down and stay in place. These simulated quadrotors learn to fly in just 18 seconds--which can then enable a real quadrotor to do the same. NYU dronesreinforcement learningsimulationrobotics It's kind of astonishing how quadrotors have scaled over the past decade. Like, we're now at the point where they're verging on disposable, at least from a commercial or research perspective--for a bit over US $200, you can buy a little 27-gram, completely open-source drone, and all you have to do is teach it to fly. That's where things do get a bit more challenging, though, because teaching drones to fly is not a straightforward process. Thanks to good simulation and techniques like reinforcement learning, it's much easier to imbue drones with autonomy than it used to be. But it's not typically a fast process, and it can be finicky to make a smooth transition from simulation to reality. New York University's Agile Robotics and Perception Lab in collaboration with the Technology Innovation Institute (TII) have managed to streamline the process of getting basic autonomy to work on drones, and streamline it by a lot: The lab's system is able to train a drone in simulation from nothing up to stable and controllable flying in 18 seconds flat on a MacBook Pro. And it actually takes longer to compile and flash the firmware onto the drone itself than it does for the entire training process. --------------------------------------------------------------------- ARPL NYU So not only is the drone able to keep a stable hover while rejecting pokes and nudges and wind, but it's also able to fly specific trajectories. Not bad for 18 seconds, right? One of the things that typically slows down training times is the need to keep refining exactly what you're training for, without refining it so much that you're only training your system to fly in your specific simulation rather than the real world. The strategy used here is what the researchers call a curriculum (you can also think of it as a sort of lesson plan) to adjust the reward function used to train the system through reinforcement learning. The curriculum starts things off being more forgiving and gradually increasing the penalties to emphasize robustness and reliability. This is all about efficiency: Doing that training that you need to do in the way that it needs to be done to get the results you want, and no more. There are other, more straightforward, tricks that optimize this technique for speed as well. The deep-reinforcement learning algorithms are particularly efficient, and leverage the hardware acceleration that comes along with Apple's M-series processors. The simulator efficiency multiplies the benefits of the curriculum-driven sample efficiency of the reinforcement-learning pipeline, leading to that wicked-fast training time. This approach isn't limited to simple tiny drones--it'll work on pretty much any drone, including bigger and more expensive ones, or even a drone that you yourself build from scratch. Jonas Eschmann We're told that it took minutes rather than seconds to train a policy for the drone in the video above, although the researchers expect that 18 seconds is achievable even for a more complex drone like this in the near future. And it's all open source, so you can, in fact, build a drone and teach it to fly with this system. But if you wait a little bit, it's only going to get better: The researchers tell us that they're working on integrating with the PX4 open source drone autopilot. Longer term, the idea is to have a single policy that can adapt to different environmental conditions, as well as different vehicle configurations, meaning that this could work on all kinds of flying robots rather than just quadrotors. Everything you need to run this yourself is available on GitHub, and the paper is on ArXiv here. From Your Site Articles * Superhuman Speed: How Autonomous Drones Beat the Best Human Racers > * AI-Powered Drone Learns Extreme Acrobatics > Related Articles Around the Web * ARPL * GitHub > dronesreinforcement learningsimulationrobotics Evan Ackerman Evan Ackerman is a senior editor at IEEE Spectrum. Since 2007, he has written over 6,000 articles on robotics and technology. He has a degree in Martian geology and is excellent at playing bagpipes. The Conversation (0) a group of young girls working on a project together involving black rods The InstituteTypeNews IEEE Foundation Day Marks a Half Century of Philanthropy 3h 3 min read Video Friday: Monocycle Robot With Legs RoboticsTypeNewsHumanoid Robots Video Friday: Monocycle Robot With Legs 4h 4 min read A person with a life-life prosthetic arm with multiple attachments on it, including strapping on two fingertips, reaches for metal squares. The squares are aligned on a surface colored red in one section and blue in another. To the side, a laptop displays heat readings for the scene. BiomedicalTypeNews Prosthetic Arm Provides Sense of Heat and Cold 4h 4 min read Related Stories RoboticsTypeNews Robotic Tongue Licks Gecko Gripper Clean RoboticsTypeNews Video Friday: Agile but Safe RoboticsTypeNewsConsumer Electronics Amazon's Acquisition of iRobot Falls Through