Machine Learning Research
The Limits of Pretraining: More pretraining doesn't guarantee a better fine-tuned AI.
The higher the accuracy of a pretrained model, the better its performance after fine-tuning, right? Not necessarily. Researchers conducted a meta-analysis of image-recognition experiments and performed some of their own.
