https://spectrum.ieee.org/quadruped-robot-wheels [ ] IEEE.orgIEEE Xplore Digital LibraryIEEE StandardsMore Sites Sign InJoin IEEE The December 2023 issue of IEEE Spectrum is here! Download PDF | Close bar ANYmal's Wheel-Hand-Leg-Arms Open Doors Playfully Share FOR THE TECHNOLOGY INSIDER Search: [ ] Explore by topic AerospaceArtificial IntelligenceBiomedicalClimate TechComputing Consumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductors TelecommunicationsTransportation IEEE Spectrum FOR THE TECHNOLOGY INSIDER Topics AerospaceArtificial IntelligenceBiomedicalClimate TechComputing Consumer ElectronicsEnergyHistory of TechnologyRoboticsSemiconductors TelecommunicationsTransportation Sections FeaturesNewsOpinionCareersDIYEngineering Resources More NewslettersPodcastsSpecial ReportsCollectionsExplainersTop Programming LanguagesRobots Guide /IEEE Job Site / For IEEE Members Current IssueMagazine ArchiveThe InstituteThe Institute Archive For IEEE Members Current IssueMagazine ArchiveThe InstituteThe Institute Archive IEEE Spectrum About UsContact UsReprints & Permissions /Advertising / Follow IEEE Spectrum Support IEEE Spectrum IEEE Spectrum is the flagship publication of the IEEE -- the world's largest professional organization devoted to engineering and applied sciences. Our articles, podcasts, and infographics inform our readers about developments in technology, engineering, and science. Join IEEE Subscribe About IEEEContact & SupportAccessibilityNondiscrimination PolicyTerms IEEE Privacy PolicyCookie Preferences (c) Copyright 2023 IEEE -- All rights reserved. A not-for-profit organization, IEEE is the world's largest technical professional organization dedicated to advancing technology for the benefit of humanity. Enjoy more free content and benefits by creating an account Saving articles to read later requires an IEEE Spectrum account The Institute content is only available for members Downloading full PDF issues is exclusive for IEEE Members Access to Spectrum's Digital Edition is exclusive for IEEE Members Following topics is a feature exclusive for IEEE Members Adding your response to an article requires an IEEE Spectrum account Create an account to access more content and features on IEEE Spectrum, including the ability to save articles to read later, download Spectrum Collections, and participate in conversations with readers and editors. For more exclusive content and features, consider Joining IEEE. Join the world's largest professional organization devoted to engineering and applied sciences and get access to all of Spectrum's articles, archives, PDF downloads, and other benefits. Learn more - CREATE AN ACCOUNTSIGN IN JOIN IEEESIGN IN Close Access Thousands of Articles -- Completely Free Create an account and get exclusive content and features: Save articles, download collections, and talk to tech insiders -- all free! For full access and benefits, join IEEE as a paying member. CREATE AN ACCOUNTSIGN IN RoboticsTopicTypeNews ANYmal's Wheel-Hand-Leg-Arms Open Doors Playfully Playful curiosity helps Swiss-Mile's custom ANYmal handle doors and boxes Evan Ackerman 02 Dec 2023 3 min read A large red quadrupedal robot with wheels at the end of its limbs balances on two legs as it opens a door and throws a package into a box. First mobility, and now manipulation. ETH Zurich quadruped robotsanymalswiss-mileeth zurichrobotics The tricked out version of the ANYmal quadruped, as customized by Zurich-based Swiss-Mile, just keeps getting better and better. Starting with a commercial quadruped, adding powered wheels made the robot fast and efficient, while still allowing it to handle curbs and stairs. A few years ago, the robot learned how to stand up, which is an efficient way of moving and made the robot much more pleasant to hug, but more importantly, it unlocked the potential for the robot to start doing manipulation with its wheel-hand-leg-arms. Doing any sort of practical manipulation with ANYmal is complicated, because its limbs were designed to be legs, not arms. But at the Robotic Systems Lab at ETH Zurich, they've managed to teach this robot to use its limbs to open doors, and even to grasp a package off of a table and toss it into a box. When it makes a mistake in the real world, the robot has already learned the skills to recover. --------------------------------------------------------------------- The ETHZ researchers got the robot to reliably perform these complex behaviors using a kind of reinforcement learning called 'curiosity driven' learning. In simulation, the robot is given a goal that it needs to achieve--in this case, the robot is rewarded for achieving the goal of passing through a doorway, or for getting a package into a box. These are very high-level goals (also called "sparse rewards "), and the robot doesn't get any encouragement along the way. Instead, it has to figure out how to complete the entire task from scratch. The next step is to endow the robot with a sense of contact-based surprise. Given an impractical amount of simulation time, the robot would likely figure out how to do these tasks on its own. But to give it a useful starting point, the researchers introduced the concept of curiosity, which encourages the robot to play with goal-related objects. "In the context of this work, 'curiosity' refers to a natural desire or motivation for our robot to explore and learn about its environment," says author Marko Bjelonic, "Allowing it to discover solutions for tasks without needing engineers to explicitly specify what to do." For the door-opening task, the robot is instructed to be curious about the position of the door handle, while for the package-grasping task, the robot is told to be curious about the motion and location of the package. Leveraging this curiosity to find ways of playing around and changing those parameters helps the robot achieve its goals, without the researchers having to provide any other kind of input. The behaviors that the robot comes up with through this process are reliable, and they're also diverse, which is one of the benefits of using sparse rewards. "The learning process is sensitive to small changes in the training environment," explains Bjelonic. "This sensitivity allows the agent to explore various solutions and trajectories, potentially leading to more innovative task completion in complex, dynamic scenarios." For example, with the door opening task, the robot discovered how to open it with either one of its end-effectors, or both at the same time, which makes it better at actually completing the task in the real world. The package manipulation is even more interesting, because the robot sometimes dropped the package in training, but it autonomously learned how to pick it up again. So, when it makes a mistake in the real world, the robot has already learned the skills to recover. There's still a bit of research-y cheating going on here, since the robot is relying on the visual code-based AprilTags system to tell it where relevant things (like door handles) are in the real world. But that's a fairly minor shortcut, since direct detection of things like doors and packages is a fairly well understood problem. Bjelonic says that the next step is to endow the robot with a sense of contact-based surprise, in order to encourage exploration, which is a little bit gentler than what we see here. Remember, too, that while this is definitely a research paper, Swiss-Mile is a company that wants to get this robot out into the world doing useful stuff. So, unlike most pure research that we cover, there's a slightly better chance here for this ANYmal to wheel-hand-leg-arm its way into some practical application. From Your Site Articles * A Quadruped Humanoid Robot Might Be Able To Do It All > * Wheels Are Better Than Feet for Legged Robots > Related Articles Around the Web * Swiss-Mile > quadruped robotsanymalswiss-mileeth zurichrobotics Evan Ackerman Evan Ackerman is a senior editor at IEEE Spectrum. Since 2007, he has written over 6,000 articles on robotics and technology. He has a degree in Martian geology and is excellent at playing bagpipes. The Conversation (0) Many grey circles pressed together. One of them has many yellow spikes rising from it. Artificial IntelligenceTopicTypeNews Error-Detection Tool Makes AI Mistakes Easy to Spot 3h 4 min read An illustration related to quantum computing and qubits ComputingTopicNewsType IBM Offers Quantum Error Suppression Out Of The Box 02 Dec 2023 4 min read Photo of IEEE President Saifur Rahman. The InstituteTopicDecember 2023MagazineArticleTypeClimate Tech IEEE President's Note: Young Technologists Grow Their Careers With IEEE 01 Dec 2023 3 min read Related Stories RoboticsTopicTypeNewsHumanoid Robots Video Friday: Tap Finger, Move Mountain RoboticsTopicAerospaceTypeNewsHumanoid Robots Video Friday: Punch-Out CareersTopicDecember 2023MagazineTypeRoboticsProfile Imagineer Morgan Pope Uses Electromagnetism to Spark Emotions