Survey of vision transformer efficiency
Survey of vision transformer efficiency
Which Transformer to Favor: A Comparative Analysis of Efficiency in Vision Transformers
arXiv paper abstract https://arxiv.org/abs/2308.09372
arXiv PDF paper https://arxiv.org/pdf/2308.09372.pdf
... popularity of Vision Transformers as the go-to models for image classification has led to an explosion of architectural modifications claiming to be more efficient than the original ViT.
... conduct ... analysis of more than 30 models to evaluate the efficiency of vision transformers and related architectures, considering various performance metrics.
... benchmark provides a comparable baseline across the landscape of efficiency-oriented transformers, unveiling ... surprising insights.
... discover that ViT is still Pareto optimal across multiple efficiency metrics, despite the existence of several alternative approaches claiming to be more efficient.
... hybrid attention-CNN models fare ... well when it comes to low inference memory and number of parameters, and also that it is better to scale the model size, than the image size.
... uncover a strong positive correlation between the number of FLOPS and the training memory, which enables the estimation of required VRAM from theoretical measurements alone ...
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
Comments