Tiny four-bit computers may enable neural nets to be trained directly on smartphones
Tiny four-bit computers may enable neural nets to be trained directly on smartphones
M.I.T. Technology Review https://www.technologyreview.com/2020/12/11/1014102/ai-trains-on-4-bit-computers/?utm_medium=tr_social&utm_campaign=site_visitor.unpaid.engagement&utm_source=Twitter#Echobox=1616457815
The IBM researchers run several experiments where they simulate 4-bit training for a variety of deep-learning models in computer vision, speech, and natural-language processing. The results show a limited loss of accuracy in the models' overall performance compared with 16-bit deep learning. The process is also more than seven times faster and seven times more energy efficient.
Please like and share this post if you enjoyed it using the buttons at the bottom!
Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact
Web site with my other posts by category https://morrislee1234.wixsite.com/website
