IEEE - Institute of Electrical and Electronics Engineers, Inc. - A Combination of Multi-state Activation Functions, Mean-normalisation and Singular Value Decomposition for learning Deep Neural Networks

2015 International Joint Conference on Neural Networks (IJCNN)

Author(s): Chenghao Cai ; Dengfeng Ke ; Yanyan Xu ; Kaile Su
Publisher: IEEE - Institute of Electrical and Electronics Engineers, Inc.
Publication Date: 1 July 2015
Conference Location: Killarney, Ireland
Conference Date: 12 July 2015
Page(s): 1 - 8
ISBN (Electronic): 978-1-4799-1960-4
ISBN (DVD): 978-1-4799-1959-8
ISSN (Electronic): 2161-4407
DOI: 10.1109/IJCNN.2015.7280321
Regular:

In this paper, we propose Multi-state Activation Functions (MSAFs) for Deep Neural Networks (DNNs). These multi-state functions do extra classification based on the 2-state Logistic function.... View More

Advertisement