Identify regions in road image mentioned in sentence

Identify regions in road image mentioned in sentence

Grounding Linguistic Commands to Navigable Regions

arXiv paper abstract https://arxiv.org/abs/2112.13031v1

arXiv PDF paper https://arxiv.org/pdf/2112.13031v1.pdf

Humans have a natural ability to effortlessly comprehend linguistic commands such as "park next to the yellow sedan" and instinctively know which region of the road the vehicle should navigate.

... propose the novel task of Referring Navigable Regions (RNR), i.e., grounding regions of interest for navigation based on the linguistic command.

... introduce a new dataset, Talk2Car-RegSeg, which extends the existing Talk2car dataset with segmentation masks for the regions described by the linguistic commands.

... show superior performance over baselines on multiple evaluation metrics.

A downstream path planner generating trajectories based on RNR outputs confirms the efficacy of the proposed framework.

Please like and share this post if you enjoyed it using the buttons at the bottom! Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact Web site with my other posts by category https://morrislee1234.wixsite.com/website #ComputerVision #Segmentation #AINewsClips #AI #ML #ArtificialIntelligence #MachineLearning