Get depth and segmentation in monocular video with self-supervised and semi-supervised with MonoDVPS
Get depth and segmentation in monocular video with self-supervised and semi-supervised with MonoDVPS
MonoDVPS: A Self-Supervised Monocular Depth Estimation Approach to Depth-aware Video Panoptic Segmentation
arXiv paper abstract https://arxiv.org/abs/2210.07577v1
arXiv PDF paper https://arxiv.org/pdf/2210.07577v1.pdf
Depth-aware video panoptic segmentation tackles the inverse projection problem of restoring panoptic 3D point clouds from video sequences, where the 3D points are augmented with semantic classes and temporally consistent instance identifiers.
... propose a novel solution with a multi-task network that performs monocular depth estimation and video panoptic segmentation.
Since ... ground truth ... has a relatively large cost ... leverage the power of unlabeled video sequences with self-supervised monocular depth estimation and semi-supervised learning from pseudo-labels for video panoptic segmentation.
To ... improve the depth prediction, ... introduce panoptic-guided depth losses and a novel panoptic masking scheme for moving objects to avoid corrupting the training signal.
... demonstrate ... model with the proposed improvements achieves competitive results and fast inference speed.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments