top of page

News to help your R&D in artificial intelligence, machine learning, robotics, computer vision, smart hardware

As an Amazon Associate I earn

from qualifying purchases

Writer's picturemorrislee

Combine knowledge of many vision transformers into a smaller multi-talented model

Combine knowledge of many vision transformers into a smaller multi-talented model


Knowledge Amalgamation for Object Detection with Transformers



Knowledge amalgamation (KA) ... aiming to transfer knowledge from several well-trained teachers to a multi-talented and compact student.


... In this work, ... explore a more effective KA scheme for transformer-based object detection models.


... propose to dissolve the KA into two aspects: sequence-level amalgamation (SA) and task-level amalgamation (TA).


... a hint is generated within the sequence-level amalgamation by concatenating teacher sequences instead of redundantly aggregating them to a fixed-size one as previous KA works.


... the student learns heterogeneous detection tasks through soft targets with efficiency in the task-level amalgamation.


... experiments on PASCAL VOC and COCO ... the sequence-level amalgamation significantly boosts the performance of students ...



Please like and share this post if you enjoyed it using the buttons at the bottom!


Stay up to date. Subscribe to my posts https://morrislee1234.wixsite.com/website/contact

Web site with my other posts by category https://morrislee1234.wixsite.com/website



49 views0 comments

Comments


ClickBank paid link

bottom of page