| Title |
Improved Error Backpropagation Algorithm using Modified Activation Function Derivative |
| Keywords |
신경망 ; 오류 역전파 ; 다층 퍼셉트론 ; 학습규칙 ; 학습마비 Neural Network ; Error Backpropagation ; Multilayer Perceptorn ; Learning Rule ; Network Paralysis |
| Abstract |
In this paper, an Improved Error Back Propagation Algorithm is introduced, which avoids Network Paralysis, one of the problems of the Error Backpropagation learning rule. For this purpose, we analyzed the reason for Network Paralysis and modified the Activation Function Derivative of the standard Error Backpropagation Algorithm which is regarded as the cause of the phenomenon. The characteristics of the modified Activation Function Derivative is analyzed. The performance of the modified Error Backpropagation Algorithm is shown to be better than that of the standard Error Back Propagation algorithm by various experiments. |