top of page

News to help your R&D in artificial intelligence, machine learning, robotics, computer vision, smart hardware

As an Amazon Associate I earn

from qualifying purchases

Writer's picturemorrislee

Survey of transformer inference optimization techniques

Survey of transformer inference optimization techniques


A Survey of Techniques for Optimizing Transformer Inference

arXiv paper abstract https://arxiv.org/abs/2307.07982



Recent ... rise in performance and applications of transformer neural networks ... However ... led to an exponential increase in transformers' memory and compute footprint.


Researchers have proposed techniques to optimize transformer inference at all levels of abstraction.


This paper presents a comprehensive survey of techniques for optimizing the inference phase of transformer networks.


... survey techniques such as knowledge distillation, pruning, quantization, neural architecture search and lightweight network design at the algorithmic level.


... further review hardware-level optimization techniques and the design of novel hardware accelerators for transformers.


... summarize the quantitative results on the number of parameters/FLOPs and accuracy of several models/techniques to showcase the tradeoff exercised by them ...



Please like and share this post if you enjoyed it using the buttons at the bottom!


Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact

Web site with my other posts by category https://morrislee1234.wixsite.com/website



63 views0 comments

Comments


ClickBank paid link

bottom of page