Get centimeter depth image from smartphone using LiDAR and unsteadiness of hand
Get centimeter depth image from smartphone using LiDAR and unsteadiness of hand
The Implicit Values of A Good Hand Shake: Handheld Multi-Frame Neural Depth Refinement
arXiv paper abstract https://arxiv.org/abs/2111.13738
arXiv PDF paper https://arxiv.org/pdf/2111.13738.pdf
Modern smartphones can continuously stream multi-megapixel RGB images at 60~Hz, synchronized with high-quality 3D pose information and low-resolution LiDAR-driven depth estimates.
... natural unsteadiness of the photographer's hands offers millimeter-scale variation in camera pose, which we can capture along with RGB and depth in a circular buffer.
... can combine dense micro-baseline parallax cues with kilopixel LiDAR depth to distill a high-fidelity depth map.
... take a test-time optimization approach and train a coordinate MLP to output photometrically and geometrically consistent depth
... method brings high-resolution depth estimates to 'point-and-shoot' tabletop photography and requires no additional hardware, artificial hand motion, or user interaction beyond the press of a button.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments