Conference paper
MON: Multiple Output Neurons
Neural Information Processing, Vol.1143
26th International Conference, ICONIP 2019 (Sydney, NSW, 12/12/2019–15/12/2019)
2019
Abstract
Existing basic artificial neurons merge multiple weighted inputs and generate a single activated output. This paper explores the applicability of a new structure of a neuron, which merges multiple weighted inputs like existing neurons, but instead of generating single output, it generates multiple outputs. The proposed “Multiple Output Neuron” (MON) can reduce computation in a basic XOR network. Furthermore, a MON based convolutional neural network layer (MONL) is described. Proposed MONL can backpropagate errors, thus can be used along with other CNN layers. MONL reduces the network computations, by reducing the number of filters. Reduced number of filters limits the network performance, thus MON based neuroevolution (MON-EVO) technique is also proposed. MON-EVO evolves the MONs into single output neurons for further improvement in training. Existing neuroevolution techniques do not utilize backpropagation but MONs can utilize backpropagation. Experimental networks trained using the CIFAR-10 classification dataset show that proposed MONL and MON-EVO provide a solution for reduced training computation and neuroevolution using backpropagation.
Details
- Title
- MON: Multiple Output Neurons
- Authors/Creators
- Y. Jan (Author/Creator)F. Sohel (Author/Creator)M.F. Shiratuddin (Author/Creator)K.W. Wong (Author/Creator)
- Publication Details
- Neural Information Processing, Vol.1143
- Conference
- 26th International Conference, ICONIP 2019 (Sydney, NSW, 12/12/2019–15/12/2019)
- Identifiers
- 991005544833507891
- Murdoch Affiliation
- Information Technology, Mathematics and Statistics
- Language
- English
- Resource Type
- Conference paper
Metrics
94 Record Views