top of page

News to help your R&D in artificial intelligence, machine learning, robotics, computer vision, smart hardware

As an Amazon Associate I earn

from qualifying purchases

Writer's picturemorrislee

Get centimeter depth image from smartphone using LiDAR and unsteadiness of hand

Get centimeter depth image from smartphone using LiDAR and unsteadiness of hand


The Implicit Values of A Good Hand Shake: Handheld Multi-Frame Neural Depth Refinement

arXiv paper abstract https://arxiv.org/abs/2111.13738




Modern smartphones can continuously stream multi-megapixel RGB images at 60~Hz, synchronized with high-quality 3D pose information and low-resolution LiDAR-driven depth estimates.


... natural unsteadiness of the photographer's hands offers millimeter-scale variation in camera pose, which we can capture along with RGB and depth in a circular buffer.


... can combine dense micro-baseline parallax cues with kilopixel LiDAR depth to distill a high-fidelity depth map.


... take a test-time optimization approach and train a coordinate MLP to output photometrically and geometrically consistent depth


... method brings high-resolution depth estimates to 'point-and-shoot' tabletop photography and requires no additional hardware, artificial hand motion, or user interaction beyond the press of a button.



Please like and share this post if you enjoyed it using the buttons at the bottom!


Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact

Web site with my other posts by category https://morrislee1234.wixsite.com/website


269 views0 comments

Comments


ClickBank paid link

bottom of page