top of page

News to help your R&D in artificial intelligence, machine learning, robotics, computer vision, smart hardware

As an Amazon Associate I earn

from qualifying purchases

Writer's picturemorrislee

Using an audio and vision transformer to count crowds

Using an audio and vision transformer to count crowds


Audio-Visual Transformer Based Crowd Counting

arXiv paper abstract https://arxiv.org/abs/2109.01926



Crowd estimation is a very challenging problem.


... address the critical challenges in crowd counting by effectively utilizing both visual and audio inputs


... introduces the notion of auxiliary and explicit image patch-importance ranking (PIR) and patch-wise crowd estimate (PCE) information to produce a third (run-time) modality.


These modalities (audio, visual, run-time) undergo a transformer-inspired cross-modality co-attention mechanism to finally output the crowd estimate.


... proposed scheme outperforms the state-of-the-art networks under all evaluation settings with up to 33.8% improvement.


We also analyze and compare the vision-only variant of our network and empirically demonstrate its superiority over previous approaches.



Please like and share this post if you enjoyed it using the buttons at the bottom! Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact Web site with my other posts by category https://morrislee1234.wixsite.com/website #ComputerVision #Surveillance #AINewsClips #AI #ML #ArtificialIntelligence #MachineLearning

15 views0 comments

Comments


ClickBank paid link

bottom of page