MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS

Volume: 3 Number: 1 January 9, 2012
  • A.J.W.M. ten Berg
  • L. Spaanenburg
EN

MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS

Abstract

Modularity and hierarchy are fundamental notions in structured system design. By subdividing a large and unstructured problem into smaller and tractable chunks, design automation becomes possible. In this paper we discuss the use of modularity and hierarchy for functional specialization during the development of neural networks. We study the behavioral differences and requirements for back-propagation training of  feed-forward networks. Further we  illustrate that a deliberate mix of hierarchically imposed evaluation functions will improve network accuracy and learning speed.

Keywords

Details

Primary Language

English

Subjects

-

Journal Section

-

Authors

A.J.W.M. ten Berg This is me

L. Spaanenburg This is me

Publication Date

January 9, 2012

Submission Date

January 9, 2012

Acceptance Date

-

Published in Issue

Year 2003 Volume: 3 Number: 1

APA
Berg, A. ten, & Spaanenburg, L. (2012). MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS. IU-Journal of Electrical & Electronics Engineering, 3(1), 719-726. https://izlik.org/JA87NH46AF
AMA
1.Berg A ten, Spaanenburg L. MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS. IU-Journal of Electrical & Electronics Engineering. 2012;3(1):719-726. https://izlik.org/JA87NH46AF
Chicago
Berg, A.J.W.M. ten, and L. Spaanenburg. 2012. “MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS”. IU-Journal of Electrical & Electronics Engineering 3 (1): 719-26. https://izlik.org/JA87NH46AF.
EndNote
Berg A ten, Spaanenburg L (January 1, 2012) MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS. IU-Journal of Electrical & Electronics Engineering 3 1 719–726.
IEEE
[1]A. ten Berg and L. Spaanenburg, “MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS”, IU-Journal of Electrical & Electronics Engineering, vol. 3, no. 1, pp. 719–726, Jan. 2012, [Online]. Available: https://izlik.org/JA87NH46AF
ISNAD
Berg, A.J.W.M. ten - Spaanenburg, L. “MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS”. IU-Journal of Electrical & Electronics Engineering 3/1 (January 1, 2012): 719-726. https://izlik.org/JA87NH46AF.
JAMA
1.Berg A ten, Spaanenburg L. MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS. IU-Journal of Electrical & Electronics Engineering. 2012;3:719–726.
MLA
Berg, A.J.W.M. ten, and L. Spaanenburg. “MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS”. IU-Journal of Electrical & Electronics Engineering, vol. 3, no. 1, Jan. 2012, pp. 719-26, https://izlik.org/JA87NH46AF.
Vancouver
1.A.J.W.M. ten Berg, L. Spaanenburg. MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS. IU-Journal of Electrical & Electronics Engineering [Internet]. 2012 Jan. 1;3(1):719-26. Available from: https://izlik.org/JA87NH46AF