Machine Learning Research
Optimize Your Training Parameters: Research on finding a neural net's optimal batch size
Last week we reported on a formula to determine model width and dataset size for optimal performance. A new paper contributes equations that optimize some training parameters.