IEEE - Institute of Electrical and Electronics Engineers, Inc. - Training Simplification and Model Simplification for Deep Learning: A Minimal Effort Back Propagation Method

Author(s): Xu Sun ; Xuancheng Ren ; Shuming Ma ; Bingzhen Wei ; Wei Li ; Jingjing Xu ; Houfeng Wang ; Yi Zhang
Sponsor(s): IEEE
Publisher: IEEE - Institute of Electrical and Electronics Engineers, Inc.
Volume: PP
Page(s): 1
ISSN (CD): 2326-3865
ISSN (Electronic): 1558-2191
ISSN (Paper): 1041-4347
DOI: 10.1109/TKDE.2018.2883613
Regular:

We propose a simple yet effective technique to simplify the training and the resulting model of neural networks. In back propagation, only a small subset of the full gradient is computed to update... View More

Advertisement