[논문 리뷰] Mixed Precision Training

Mixed Precision Training Deep neural networks have enabled progress in a wide variety of applications. Growing the size of the neural network typically results in improved accuracy. As model sizes grow, the memory and compute requirements for training these models also increases. arxiv.org Mixed Precision Training이라는 논문에 대해 살펴보도록 하겠다 딥러닝이 발전함에 따라, 다양한 분야에서 큰 발전이 이루어졌다. 이러한 발전에는 training dataset의..

원문링크 : [논문 리뷰] Mixed Precision Training