🧬Efficiency
Knowledge Distillation
Transferring knowledge to smaller models
240 papers
Compare with other topicsAlso includes: knowledge distillation, distillation, teacher-student, model distillation
Transferring knowledge to smaller models
Rishabh Agarwal, Nino Vieillard, Yongchao Zhou et al.
Shangquan Sun, Wenqi Ren, Jingzhi Li et al.
Yuxian Gu, Li Dong, Furu Wei et al.
JiaBao Wang, yuming chen, Zhaohui Zheng et al.
Chuanguang Yang, Zhulin An, Libo Huang et al.
Zheng Li, Xiang Li, xinyi fu et al.
Yushi Hu, Otilia Stretcu, Chun-Ta Lu et al.
Jongwoo Ko, Sungnyun Kim, Tianyi Chen et al.
Keon Hee Park, Kyungwoo Song, Gyeong-Moon Park
Yuan Zhang, Tao Huang, Jiaming Liu et al.
Longxiang Tang, Zhuotao Tian, Kai Li et al.
Jiajun Liu, Ke Wenjun, Peng Wang et al.
Yuqi Li, Chuanguang Yang, Hansheng Zeng et al.
Fangxun Shu, Yue Liao, Lei Zhang et al.
Kaixiang Zheng, EN-HUI YANG
Wenda Xu, Rujun Han, Zifeng Wang et al.
Zhiqiu Xu, Yanjie Chen, Kirill Vishniakov et al.
Xiaoshuai Hao, Ruikai Li, Hui Zhang et al.
Justin Chih-Yao Chen, Swarnadeep Saha, Elias Stengel-Eskin et al.
Kunlun Xu, Xu Zou, Yuxin Peng et al.
Yuxuan Jiang, Chen Feng, Fan Zhang et al.
He Liu, Yikai Wang, Huaping Liu et al.
Xiao Cui, Mo Zhu, Yulei Qin et al.
Roy Miles, Ismail Elezi, Jiankang Deng
Kaicheng Yang, Tiancheng Gu, Xiang An et al.
Wenxuan Zhang, Paul Janson, Rahaf Aljundi et al.
Sungmin Cha, Sungjun Cho, Dasol Hwang et al.
Jianqing Zhang, Yang Liu, Yang Hua et al.
jiajun cao, Yuan Zhang, Tao Huang et al.
Brian Moser, Federico Raue, Sebastian Palacio et al.
Dan Friedman, Andrew Lampinen, Lucas Dixon et al.
Marco Mistretta, Alberto Baldrati, Marco Bertini et al.
Yunzhen Feng, Shanmukha Ramakrishna Vedantam, Julia Kempe
Qianlong Xiang, Miao Zhang, Yuzhang Shang et al.
Amin Parchami, Moritz Böhle, Sukrut Rao et al.
Yannis Kalantidis, Larlus Diane, Mert Bulent SARIYILDIZ et al.
Yuxian Gu, Hao Zhou, Fandong Meng et al.
Xuxi Chen, Yu Yang, Zhangyang Wang et al.
Karsten Roth, Lukas Thede, A. Sophia Koepke et al.
Yuzheng Wang, Dingkang Yang, Zhaoyu Chen et al.
Yu Wang, Xin Li, Shengzhao Wen et al.
Ming Zhong, Chenxin An, Weizhu Chen et al.
Yu-Chu Yu, Chi-Pin Huang, Jr-Jen Chen et al.
Jiyeon Kim, Hyunji Lee, Hyowon Cho et al.
Benjamin Minixhofer, Ivan Vulić, Edoardo Maria Ponti
Huanxuan Liao, Shizhu He, Yao Xu et al.
Chuanguang Yang, XinQiang Yu, Han Yang et al.
Cheng Han, Qifan Wang, Sohail A Dianat et al.
Vishaal Udandarao, Nikhil Parthasarathy, Muhammad Ferjad Naeem et al.
Kaituo Feng, Changsheng Li, Dongchun Ren et al.
Yu Wang, Ruihan Wu, Zexue He et al.
Ayan Sengupta, Shantanu Dixit, Md Shad Akhtar et al.
Ruonan Yu, Songhua Liu, Jingwen Ye et al.
Dong-Dong Wu, Deng-Bao Wang, Min-Ling Zhang
Makoto Shing, Kou Misaki, Han Bao et al.
Minki Kang, Jongwon Jeong, Seanie Lee et al.
Muhammed Ildiz, Halil Gozeten, Ege Taga et al.
William Yang, Ye Zhu, Zhiwei Deng et al.
Sy-Tuyen Ho, Koh Jun Hao, Keshigeyan Chandrasegaran et al.
Authors: Jiang-Tian Zhai, Xialei Liu, Lu Yu et al.
Shayan Mohajer Hamidi, Xizhen Deng, Renhao Tan et al.
Raviteja Vemulapalli, Hadi Pouransari, Fartash Faghri et al.
Yu Zhou, Dian Zheng, Qijie Mo et al.
Sanmin Kim, Youngseok Kim, Sihwan Hwang et al.
Yuzheng Wang, Zhaoyu Chen, Dingkang Yang et al.
Mingjian Zhi, Yuanguo Bi, Wenchao Xu et al.
Zongqian Wu, Yujie Mo, Peng Zhou et al.
Fadi Boutros, Vitomir Struc, Naser Damer
Seungwoo Son, Jegwang Ryu, Namhoon Lee et al.
Wujie Sun, Defang Chen, Siwei Lyu et al.
Shoumeng Qiu, Jie Chen, Xinrun Li et al.
Chengyu Dong, Liyuan Liu, Jingbo Shang
Abhishek Panigrahi, Bingbin Liu, Sadhika Malladi et al.
Reza Shirkavand, Peiran Yu, Shangqian Gao et al.
Kunxi Li, Tianyu Zhan, Kairui Fu et al.
Andrei Lupu, Chris Lu, Jarek Liesen et al.
En-Hui Yang, Linfeng Ye
Yuzhu Wang, Lechao Cheng, Manni Duan et al.
Shikai Qiu, Boran Han, Danielle Robinson et al.
Xinyue Liu, Jianyuan Wang, Biao Leng et al.
Jing Xu, Jiazheng Li, Jingzhao Zhang
Lucas Caccia, Alan Ansell, Edoardo Ponti et al.
Saeed Khorram, Mingqi Jiang, Mohamad Shahbazi et al.
Jianhua Zhang, Yi Gao, Ruyu Liu et al.
Guiqin Wang, Peng Zhao, Yanjiang Shi et al.
Jialiang Tang, Shuo Chen, Gang Niu et al.
Hyunjune Shin, Dong-Wan Choi
Sayantan Dasgupta, Trevor Cohn
Jitai Hao, Qiang Huang, Hao Liu et al.
Shengji Tang, Peng Ye, Baopu Li et al.
Yucheng Xie, Fu Feng, Ruixiao Shi et al.
Bruce W, Lee, Addie Foote, Alex Infanger et al.
Kento Nishi, Rahul Ramesh, Maya Okawa et al.
Junjie Zhou, Ke Zhu, Jianxin Wu
Qizhen Lan, Qing Tian
Daniil Tiapkin, Daniele Calandriello, Johan Ferret et al.
Cunhang Fan, Yujie Chen, Jun Xue et al.
Aditya Singh, Haohan Wang
Nikita Starodubcev, Dmitry Baranchuk, Artem Fedorov et al.