top of page

News to help your R&D in artificial intelligence, machine learning, robotics, computer vision, smart hardware

As an Amazon Associate I earn

from qualifying purchases

Writer's picturemorrislee

Advantages of nested transformers for computer vision

Advantages of nested transformers for computer vision


Aggregating Nested Transformers

arXiv paper abstract https://arxiv.org/abs/2105.12723



... explore ... nesting basic local transformers on non-overlapping image blocks and aggregating them in a hierarchical manner.

... leads ... to ... a simplified architecture with minor code changes upon the original vision transformer and obtains improved performance compared to existing methods.

... converges faster and requires much less training data

... Training a NesT with 6M parameters from scratch on CIFAR10 achieves 96% accuracy using a single GPU, setting a new state of the art for vision transformers.


Please like and share this post if you enjoyed it using the buttons at the bottom!


Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact

Web site with my other posts by category https://morrislee1234.wixsite.com/website


38 views0 comments

Comments


ClickBank paid link

bottom of page