Real-time super-resolution video by propagating the motion field of the previous frame with TMP
Real-time super-resolution video by propagating the motion field of the previous frame with TMP
TMP: Temporal Motion Propagation for Online Video Super-Resolution
arXiv paper abstract https://arxiv.org/abs/2312.09909
arXiv PDF paper https://arxiv.org/pdf/2312.09909.pdf
Online video super-resolution (online-VSR) ... relies on ... alignment ... to aggregate temporal information, while ... latency requirement makes ... alignment ... challenging.
... existing online-VSR methods estimate the motion fields of each frame separately ... which is ... redundant and ignores ... motion fields of adjacent frames are correlated.
... propose an efficient Temporal Motion Propagation (TMP) method, which leverages the continuity of motion field to achieve fast pixel-level alignment among consecutive frames.
... propagate the offsets from previous frames to the current frame, and ... refine them in the neighborhood, which significantly reduces the matching... and speeds ... offset estimation
... to enhance the robustness of alignment, ... perform spatial-wise weighting on the warped features, where the positions with more precise offsets are assigned higher importance.
... proposed TMP method achieves leading online-VSR accuracy as well as inference speed ...
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments