https://www.optica.org/en-us/about/newsroom/news_releases/2022/september/lensless_camera_creates_3d_images_from_single_expo/ Skip to main content This website uses cookies to deliver some of our products and services as well as for analytics and to provide you a more personalized experience. Visit our Cookie Notice to learn more. By continuing to use this site, you agree to our use of cookies. We've also updated our Privacy Notice. Visit our Privacy Policy to see what's new. [Allow all cookies] Optica | Formerly OSA [ ] [Search] Search Join Optica Log In Other Optica Sites Other Optica Sites * Optica Publishing Group * Optica Store * Prism * OPN * BEAM * FIO+LS * CLEO * OFC * Optics 4 Kids * Work in Optics * Living History * GEMM Initiative * NPI * Publications Submit a paper to Optica Publishing Group's world-class journals. Submit a Paper > Learn more about our Open Access options. Open Access Overview > Discover how to provide access to our content at your institution. Library Subscriptions > * Events + Event Calendar + Exhibits & Sponsorships + Services + Archives Keep current with events and meetings information. Sign up for email notifications > We recognize meetings that enhance the optics and photonics community. Request an endorsement > * Membership + Join Optica + Benefits & Services + Member Programs + Member Resources + Distinguished & Honorary Connect with an unparalleled global network of leading optics and photonics professionals. Join Optica > Exclusive access to an industry network, cutting-edge information and valuable resources to enhance your career and grow your business. Benefits & Services > * Industry + Corporate Membership + Industry Intelligence + Industry Events + Promotional Opportunities Make better business decisions with trusted industry intelligence from Optica. Industry Intelligence > Grow your business network at an Optica industry event. Industry Events > * Careers + Explore Careers + For Employers + Professional Development Submit your job listing to Work in Optics Add a job listing > Career Webinars Career Programming > * Foundation + Donate + Opportunities + NextGen Institute + About Support and recognize the next generation of optics and photonics Donate > Read our annual report and highlights from 2020 Explore our impact > * Get Involved + Awards & Honors + Diversity, Equity and Inclusion + Early Career + Education Outreach + Global Policy & Affairs + Local Sections + Students + Technical Groups + Volunteer Expand your network and discover tailored events and activities Join a Technical Group > Several of Optica's awards and honors are accepting nominations. Learn more. Nominate a colleague > * About + Optica Community + About Our Brand + Strategy + Leadership and Volunteers + Newsroom + Living History + Work at Optica + Video Library + Contact Us + Policies Other Optica Sites Search Menu Other Optica Sites * Optica Publishing Group * PRISM * BEAM * FIO+LS * CLEO * OFC * Optics 4 Kids * Living History * GEMM * NPI [ ] [Search] Menu * Publications * Events + Event Search + Event Services + Archives * Membership + Join Optica + Benefits & Services + Member Programs + Member Resources + Distinguished & Honorary * Industry + Corporate Membership + Industry Intelligence + Industry Events + Promotional Opportunities * Careers + Explore Careers + For Employers + Professional Development * Foundation + Donate + Opportunities + NextGen Institute + About * About + Optica Community + About Our Brand + Strategy + Leadership and Volunteers + Newsroom + What are Optics & Photonics? + Living History + Work at Optica + Contact Us + Policies * Get Involved + Awards & Honors + Diversity, Equity and Inclusion + Early Career + Education Outreach + Global Policy & Affairs + Local Sections + Students + Technical Groups + Volunteer Join Optica Log In Home / About / Newsroom / News Releases Menu * Optica Community * About Our Brand + Guiding Principles + Logos and Use Guidelines + Faces of Optica + Frequently Asked Questions * Strategy * Leadership & Volunteers + Board of Directors + Volunteer Opportunities + Past Officers + Councils and Committees + Executive Staff + Election for 2023 Offices * Newsroom + News Releases + Optica in the News + Corporate Member News + Member News + Discover Optica Blog + Obituaries + Optica Press Kit + Logos and Use Guidelines + Media Relations + Social Media Hub * What are Optics & Photonics? * Living History * Work at Optica * Contact Us + Global Headquarters + Visit Optica * Policies + Code of Conduct + Event Policies and Terms + Privacy Policy + Terms of Use + Cookie Notice + Health and Safety Practices + Registration Waivers for Eme... About * Optica Community * About Our Brand + Guiding Principles + Logos and Use Guidelines + Faces of Optica + Frequently Asked Questions * Strategy * Leadership & Volunteers + Board of Directors + Volunteer Opportunities + Past Officers + Councils and Committees + Executive Staff + Election for 2023 Offices * Newsroom + News Releases + Optica in the News + Corporate Member News + Member News + Discover Optica Blog + Obituaries + Optica Press Kit + Logos and Use Guidelines + Media Relations + Social Media Hub * Living History * Work at Optica * Contact Us + Global Headquarters + Visit Optica * Policies + Code of Conduct + Event Policies and Terms + Privacy Policy + Terms of Use + Cookie Notice 7 September 2022 Lensless camera creates 3D images from single exposure Real-time 3D imaging method could improve robot navigation and content for 3D displays WASHINGTON--Researchers have developed a camera that uses a thin microlens array and new image processing algorithms to capture 3D information about objects in a scene with a single exposure. The camera could be useful for a variety of applications such as industrial part inspection, gesture recognition and collecting data for 3D display systems. [weijian-ya] Caption: Weijian Yang and Feng Tian developed a camera that uses a thin microlens array and new image processing algorithms to capture 3D information about multiple objects in single exposure. The raw sub-images from the microarray are displayed on the monitor. Image Credit: Savannah Luy, University of California - Davis "We consider our camera lensless because it replaces the bulk lenses used in conventional cameras with a thin, lightweight microlens array made of flexible polymer," said research team leader Weijian Yang from the University of California, Davis. "Because each microlens can observe objects from different viewing angles, it can accomplish complex imaging tasks such as acquiring 3D information from objects partially obscured by objects closer to the camera." In the Optica Publishing Group journal Optics Express, Yang and first author Feng Tian, a doctoral student in Yang's lab, describe the new 3D camera. Because the camera learns from existing data how to digitally reconstruct a 3D scene, it can produce 3D images in real time. "This 3D camera could be used to give robots 3D vision, which could help them navigate 3D space or enable complex tasks such as manipulation of fine objects," said Yang. "It could also be used to acquire rich 3D information that could provide content for 3D displays used in gaming, entertainment or many other applications." A camera that learns The new camera grew out of previous work in which the researchers developed a compact microscope that can image 3D microscopic structures for biomedical applications. "We built the microscope using a microlens array and thought that a similar concept could be applied for imaging macroscopic objects," said Yang. The individual lenses in the new camera allow it to see objects from different angles or perspectives, which provides depth information. Although other research groups have developed cameras based on single layer microlens arrays, it has been difficult to make them practical because of extensive calibration processes and slow reconstruction speeds. "Many existing neural networks can perform designated tasks, but the underlying mechanism is difficult to explain and understand," said Yang. "Our neural network is based on a physical model of image reconstruction. This makes the learning process much easier and results in high quality reconstructions." Once the learning process is complete, it can reconstruct images containing objects that are at different distances away from the camera at a very high speed. The new camera doesn't need calibration and can be used to map the 3D locations and spatial profiles--or outlines--of objects. Seeing through objects [0818txtps] Caption: The single-shot image acquired by the new camera can be refocused and reconstructed to reveal object scenes at different distances. Image Credit: : Feng Tian, University of California - Davis After performing numerical simulations to verify the camera's performance, the researchers performed 2D imaging that showed perceptually pleasing results. They then tested the camera's ability to perform 3D imaging of objects at different depths. The resulting 3D reconstruction could be refocused to different depths or distances. The camera also created a depth map that agreed with the actual object arrangement. "In a final demonstration we showed that our camera could image objects behind the opaque obstacles," said Yang. "To the best of our knowledge, this is the first demonstration of imaging objects behind opaque obstacles using a lensless camera." The researchers are currently working to reduce artifacts, or errors, that appear in the 3D reconstructions and to improve the algorithms to gain even higher quality and speed. They also want to miniaturize the overall device footprint so it could fit into a cellphone, which would make it more portable and enable more applications. "Our lensless 3D camera uses computational imaging, an emerging approach that jointly optimizes imaging hardware and object reconstruction algorithms to achieve desired imaging tasks and quality," said Yang. "With the recent development of low-cost, advanced micro-optics manufacturing techniques as well as advancements in machine learning and computational resources, computational imaging will enable many new imaging systems with advanced functionality." Paper: F. Tian, W. Yang, "Learned lensless 3D camera," Opt. Express, 30, 19, 34479-34496 (2022). DOI: 10.1364/OE.465933. About Optics Express Optics Express reports on scientific and technology innovations in all aspects of optics and photonics. The bi-weekly journal provides rapid publication of original, peer-reviewed papers. It is published by Optica Publishing Group and led by Editor-in-Chief James Leger of the University of Minnesota, USA. Optics Express is an open-access journal and is available at no cost to readers online. For more information, visit Optics Express. About Optica Publishing Group (formerly OSA) Optica Publishing Group is a division of the society, Optica (formerly OSA), Advancing Optics and Photonics Worldwide. It publishes the largest collection of peer-reviewed and most-cited content in optics and photonics, including 18 prestigious journals, the society's flagship member magazine, and papers and videos from more than 835 conferences. With over 400,000 journal articles, conference papers and videos to search, discover and access, our publications portfolio represents the full range of research in the field from around the globe. Media Contact mediarelations@optica.org Share: Optica.org * Publications * Events * Membership * Industry Information * Help * Contact Us * Policies & Legal Helpful Links * Join Optica or Renew * Store * Find an Event About Us Optica, advancing optics and photonics worldwide. Facebook Twitter LinkedIn YouTube Instagram Copyright (c) 2022 Optica www.optica.org You are navigating to the Optica Events Slack Workspace. If you are not already logged into your free Slack account, you will be asked to create one. Please note that this is different from your Optica account. Continue to Slack >