Enhance video taken with only starlight by using a physics-based noise model

Enhance video taken with only starlight by using a physics-based noise model

Dancing under the stars: video denoising in starlight

arXiv paper abstract https://arxiv.org/abs/2204.04210v1

arXiv PDF paper https://arxiv.org/pdf/2204.04210v1.pdf

Imaging in low light is extremely challenging due to low photon counts.

... demonstrate photorealistic video under starlight (no moon present, <0.001 lux) for the first time.

To enable this, ... develop a GAN-tuned physics-based noise model to more accurately represent camera noise at the lowest light levels.

Using this noise model, ... train a video denoiser using a combination of simulated noisy video clips and real noisy still images.

... capture a 5-10 fps video dataset with significant motion at approximately 0.6-0.7 millilux with no active illumination.

... achieve improved video quality at the lowest light levels, demonstrating photorealistic video denoising in starlight for the first time.

Please like and share this post if you enjoyed it using the buttons at the bottom! Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact Web site with my other posts by category https://morrislee1234.wixsite.com/website LinkedIn https://www.linkedin.com/in/morris-lee-47877b7b #ComputerVision #Enhancement #AINewsClips #AI #ML #ArtificialIntelligence #MachineLearning