http://image-sensors-world.blogspot.com/2022/05/extreme-depth-of-field-light-field.html Image Sensors World News and discussions about image sensors Tuesday, May 03, 2022 Extreme depth-of-field light field camera An article titled "Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field" by Q. Fan et al. proposes a metalens design inspired by the bi-focal vision system of an extinct marine arthropod. Abstract A unique bifocal compound eye visual system found in the now extinct trilobite, Dalmanitina socialis, may enable them to be sensitive to the light-field information and simultaneously perceive both close and distant objects in the environment. Here, inspired by the optical structure of their eyes, we demonstrate a nanophotonic light-field camera incorporating a spin-multiplexed bifocal metalens array capable of capturing high-resolution light-field images over a record depth-of-field ranging from centimeter to kilometer scale, simultaneously enabling macro and telephoto modes in a snapshot imaging. By leveraging a multi-scale convolutional neural network-based reconstruction algorithm, optical aberrations induced by the metalens are eliminated, thereby significantly relaxing the design and performance limitations on metasurface optics. The elegant integration of nanophotonic technology with computational photography achieved here is expected to aid development of future high-performance imaging systems. [41467_2022_29568_Fig1_HTML] a Conceptual sketch of extinct trilobite Dalmanitina socialis and its compound eyes. Each compound eye, composed of a lower lens unit and an upper lens unit with central bulge, can simultaneously focus the incident light to near and far point, similar to a coaxial bifocal lens. b The bioinspired photonic spin-multiplexed metalens array. The unit cell of metalens array is composed of rectangle amorphous TiO2 nanopillar sitting on a SiO2 substrate with Px=Py=450 nm, and height h=600 nm. c Optical microscope image of the fabricated metalens array. The right panel shows a zoomed-in image of 3 x 3 submetalens array. d The scanning electron microscopy (SEM) images show the top view and oblique view of the TiO2 nanopillars. [41467_2022_29568_Fig2_HTML] Focal spots in the x-y and x-z plane for (a) LCP and (b) RCP incident light at the wavelength of 530 nm. For ease-of-viewing, here we show an array of 12 x 12 focal spots (top left). The solid white lines show the horizontal cuts of the intensity distributions of focal spots. c Dispersion of a single submetalens illustrated by metalens focusing at different focal lengths for the wavelength spanning from 460 nm to 700 nm. The incident light is linearly polarized. [41467_2022_29568_Fig3_HTML] a Conceptual sketch of the proposed light-field imaging camera. b Schematic diagram of the working principle of the system with metalens array achieving spin-dependent bifocal light-field imaging. Either the LCP component of close object or the RCP component of distant object could be focused well on the identical imaging plane. The nominal distance between the primary lens and metalens array is L =47.5 mm. The nominal distance between the imaging plane and metalens array is l=0.83 mm. The focal length and aperture size of the primary lens is F=50 mm and D=6 mm, respectively. c The captured PSFs at different depths for LCP, RCP, and UP (unpolarized) incident light. d Demonstration of working range for different polarization states. The light-blue region and light-red region represent the working range of LCP and RCP components, respectively. The vertical axis represents the PSF ranks, for which the smaller value corresponds to better imaging quality. The uncertainties are standard deviation for repeated measurements (six in total). [41467_2022_29568_Fig4_HTML] a PSF capture and training-data generation. b Aberration removal with the proposed multiscale deep convolutional neural network. The distance between the primary lens and Matryoshka nesting dolls: 0.3 m, 0.5 m, 1.0 m, 1.5 m, 2.3 m, and 3.3 m. The insets show the nearest and farthest Matryoshka nesting dolls. c Light-field processing based on the retrieved all-in-focus light-field images, including disparity estimation and refocusing images at different depths. [41467_2022_29568_Fig5_HTML] a Captured subimages of a USAF 1951 resolution chart at different depths. For easy recognition, here we show the 3x3 subimages. b Aberration-corrected subimages. c Top: Rendered center-of-view images of the USAF 1951 resolution chart. Bottom: Zoom-in images and intensity cross sections of each smallest-resolvable line pair in the resolution chart. [41467_2022_29568_Fig6_HTML] a, b Captured light-field subimages of the whole scene under natural light (a) before and (b) after aberration correction. c, d Zoomed-in subimages of different objects corresponding to the marked ones shown in (a, b), respectively. e Aberration-corrected all-in-focus image after rendering. The reconstructed NJU characters have been reasonably shifted and scaled for easy viewing. Link: https://www.nature.com/articles/s41467-022-29568-y Posted by Atul Ingle at 19:30 # Email ThisBlogThis!Share to TwitterShare to FacebookShare to Pinterest No comments: Post a Comment All comments are moderated to avoid spam and personal attacks. Newer Post Older Post Home Subscribe to: Post Comments (Atom) Blog Authors * Vladimir Koifman * Atul Ingle * Mark Sapp Search the Blog * Bing * Google * Twitter Translate Blog Archive * V 2022 (160) + V May (5) o Will event-cameras dominate computer vision? o Lightweight object detection on the edge o Low Light Video Denoising o Extreme depth-of-field light field camera o "Photon counting cameras for quantum imaging appli... + > April (21) + > March (41) + > February (36) + > January (57) * > 2021 (689) + > December (55) + > November (52) + > October (48) + > September (55) + > August (44) + > July (49) + > June (61) + > May (66) + > April (67) + > March (78) + > February (49) + > January (65) * > 2020 (795) + > December (61) + > November (59) + > October (70) + > September (62) + > August (64) + > July (62) + > June (58) + > May (78) + > April (74) + > March (71) + > February (64) + > January (72) * > 2019 (701) + > December (70) + > November (54) + > October (58) + > September (51) + > August (42) + > July (56) + > June (62) + > May (74) + > April (52) + > March (64) + > February (57) + > January (61) * > 2018 (758) + > December (64) + > November (67) + > October (67) + > September (68) + > August (47) + > July (56) + > June (55) + > May (70) + > April (55) + > March (71) + > February (61) + > January (77) * > 2017 (715) + > December (65) + > November (68) + > October (64) + > September (63) + > August (48) + > July (48) + > June (63) + > May (63) + > April (50) + > March (59) + > February (52) + > January (72) * > 2016 (635) + > December (50) + > November (54) + > October (49) + > September (58) + > August (56) + > July (49) + > June (59) + > May (53) + > April (54) + > March (46) + > February (48) + > January (59) * > 2015 (695) + > December (40) + > November (52) + > October (70) + > September (50) + > August (57) + > July (67) + > June (56) + > May (51) + > April (61) + > March (63) + > February (67) + > January (61) * > 2014 (586) + > December (47) + > November (48) + > October (53) + > September (56) + > August (56) + > July (38) + > June (41) + > May (44) + > April (47) + > March (42) + > February (63) + > January (51) * > 2013 (612) + > December (34) + > November (68) + > October (53) + > September (59) + > August (60) + > July (45) + > June (43) + > May (59) + > April (51) + > March (33) + > February (63) + > January (44) * > 2012 (520) + > December (33) + > November (58) + > October (40) + > September (36) + > August (39) + > July (36) + > June (45) + > May (46) + > April (29) + > March (51) + > February (62) + > January (45) * > 2011 (489) + > December (41) + > November (48) + > October (47) + > September (35) + > August (28) + > July (40) + > June (39) + > May (42) + > April (39) + > March (44) + > February (50) + > January (36) * > 2010 (437) + > December (39) + > November (44) + > October (39) + > September (28) + > August (24) + > July (28) + > June (32) + > May (38) + > April (36) + > March (41) + > February (50) + > January (38) * > 2009 (409) + > December (38) + > November (35) + > October (43) + > September (37) + > August (34) + > July (35) + > June (33) + > May (33) + > April (31) + > March (18) + > February (34) + > January (38) * > 2008 (396) + > December (36) + > November (32) + > October (45) + > September (38) + > August (27) + > July (28) + > June (31) + > May (34) + > April (30) + > March (30) + > February (31) + > January (34) * > 2007 (310) + > December (19) + > November (37) + > October (27) + > September (14) + > August (18) + > July (18) + > June (20) + > May (26) + > April (23) + > March (25) + > February (43) + > January (40) * > 2006 (162) + > December (24) + > November (22) + > October (10) + > September (9) + > August (11) + > July (9) + > June (9) + > May (16) + > April (9) + > March (12) + > February (15) + > January (16) * > 2005 (24) + > December (16) + > November (8) Pageviews (30 days) 15 Recent Comments Subscribe to RSS headline updates from: Powered by FeedBurner Most Popular Posts (7 days) * [ABLy4Eyp5U] Extreme depth-of-field light field camera An article titled "Trilobite-inspired neural nanophotonic light-field camera with extreme depth-of-field" by Q. Fan et al. propose... * [ABLy4EzUup] 90-min Tutorial on Single Photon Detectors Krister Shalm of National Institute of Standards and Technologies presented a tutorial: Single-photon detectors at the 2013 QCrypt Conferenc... * [ABLy4Ewy7N] "Photon counting cameras for quantum imaging applications" Prof. Edoardo Charbon "Photon counting cameras for quantum imaging applications" Prof. Edoardo Charbon, Full Professor, Advanced Quantum Architecture L... * [AVvXsEisLY] Low Light Video Denoising A team from UC Berkeley and Intel Labs has posted a new pre-print titled "Dancing under the stars: video denoising in starlight". ... * [ABLy4Ez9d0] Samsung making a new larger ISOCELL camera sensor? Samsung is the world's second-biggest mobile camera sensor maker, and its sensors are used by almost every smartphone brand. Over the past c... Lists * Image Sensor Companies * Ecosystem Companies * Companies Genealogy Image Sensor News * Arxiv.org * Baidu News * BBC News * Bing News * Business Wire * GlobeNewsWire * Google .pdf Files Weekly * Google News * JCN Newswire * PR Newswire * PR Web * Pressebox * ReleaseWire News * ResearchGate * Reuters * Twitter * Vimeo * Yahoo News * Youtube Imaging Links * Abbas El Gamal Publications * Adimec Blog * Advanced Imaging Pro * Albert Theuwissen' Blog * Apertus Open Source Camera * Cambridge In Colour * Camera Module Forum (Chinese) * Camera Module Portal (Chinese) * Camera Wiki * Carnegie Mellon Vision Lectures * CCD University * CCD-World Archive * Chipworks Blog * CIPA * Clarkvision * Color Filters Array Design * Columbia Univ. Vision Lab * Computer Vision Books * Computer Vision Online * CPIQ * DALSA CCD vs CMOS * Delft Univ. Image Processing * Delft Univ. Repository * Digital Camera Database * Digital Camera History * DxOMark * Edinburgh University archive * Embedded Vision Alliance * Emil Martinec DSLR Sensors Page * Eric Fossum Dartmouth College * Eric Fossum Publications * ETH Tobi Delbruck Page * FBK * Fujifilm Color Filters * Google Photo Technology Videos * GREYCstoration * I-Micronews 3D Packaging * I3A Industry News * Image Processing Book Blog * Image Sensor Database * Image Sensor Jobs at LinkedIn * Image Sensors Workshop * Imager Mania (Japanese) * Imaging Executive Podcast * IMV Europe * Industrial Cameras Vision Tech Blog * Kawahito Lab * Keith Fife 3D Publcations * Kinect Hacks * Lane Brooks Publications * LightField Forum * Machine Vision Portal * Magcam - Magnetic Camera * MISPIA * MIT Charles Sodini * MIT Media Lab Presentations * Mitsubishi Focus Enhancement * News from Japan (via Bing) * News from Japan (via Google) * NHK Broadcast Magazine * Nuit Blanche Blog * Open Source Camera (Elphel) * OpenNI * Pixelchips * PV CDROM * QE, FW and Noise Data * Rick Baer's kilopixel.net * RIT Imaging Seminars * Rutherford Lab * SemiconDr Blog * Sensors Journal * Smart Robot Blog * Spectronet Videos * Stanford Crosstalk Study * Stanford Image Sys. Eng. Cntr * Stanford Scien Projects * TAU Lecture Notes * Teledyne DALSA Blog * Terahertz Technology Blog * Toshiba CIS Articles * Toshiba Eye on Sensors Blog * TSR * UCSB Turks Page * Van Zeghbroeck Device Physics * Video/Imaging Designline * York Univ. VISOR Group * Youtube Image Sensor Channel * Youtube ISW Videos General Interest Links * 3D IC Forum * Analog and DSP * Chip Estimate IP Portal * ChipWorks Blog * Circuit Sage * Company Name Etymologies * Compressive Sensing Blog * Deep Chip * Design & Reuse IP Portal * Digitimes * EDA Board * EDN Anablog * EE Times Asia * EETimes * Electrons and Holes Twitter * EN-Genius Network * Flintbox IP Portal * Google Papers Repository * IEEE ED Letters * IEEE JSSC * IEEE TCE * IEEE TED * IEEE Xplore * Intech Open Books * Machine Vision 4 Users * Matryoshka World * NPTEL Analog Course * NPTEL Video Courses * PC Electronic Components Blog * PC Telecom Blog * Phillip Allen Page * Planet Analog * SCIYO Free Books * Semiconductor Geek * SemiWiki * SRIM Simulator * Tech-On! * TechOnline * The Designers Guide * The Digital Electronics Blog Subscribe To [arrow_drop] [icon_feed1] Posts [subscribe-] [subscribe-] [icon_feed1] Atom [arrow_drop] [icon_feed1] Posts [arrow_drop] [icon_feed1] Comments [subscribe-] [subscribe-] [icon_feed1] Atom [arrow_drop] [icon_feed1] Comments Watermark theme. Powered by Blogger.