On Good Practices for Task-Specific Distillation of Large Pretrained Visual Models
Published in Transactions on Machine Learning Research (TMLR), 2024
Juliette Marrie, Michael Arbel, Julien Mairal, Diane Larlus
This paper delineates good practices for leveraging current large pretrained visual models to train a small model on a specific task.