Hyun-Kyo Lim, Ju-Bong Kim, Do-Hyung Kwon, Youn-Hee Han,

Journal of Advanced Technology Research, Vol. 2, No. 1, pp. 6-14, Jun. 2017
10.11111/JATR.2017.2.1.002, Full Text:
Keywords: Machine-Learning, Deep Learning, Convolution Neural Network, Neural Network, Optimizer
Abstract

As interest in Machine-Learning has increased in recent years, interest in Deep-Learning Neural Networks is growing. Especially, the appearance of various Neural Networks has increased the interest of optimization algorithms on network parameters used in networks. Algorithms for optimizing network parameters are also emerging as various Neural Networks are introduced. However, since the new optimizers are not optimized for all Neural Networks, there is a problem that the learning result value varies depending on the input values of the learning data and the network parameter values. In this paper, we introduce network parameter optimization algorithms to minimize the value of loss function. For this, we compare the accuracy of CNN learning results of MNIST according to Gradient Descent, Momentum, Adagrad, Adadelta, and Adam Optimizers Respectively.

Statistics
Cite this article