ELECTRICA

MODULAR AND HIERARCHICAL SPECIALIZATION IN NEURAL NETWORKS

1.

Lund University, Department of Information Technology, P.O. Box 118, S-22100 Lund, Sweden

2.

currently with Philips Research Laboratories, Eindhoven, The Netherlands

ELECTRICA 2003; 3: 719-726
Read: 466 Downloads: 344 Published: 28 December 2019

Modularity and hierarchy are fundamental notions in structured system design. By subdividing a large and unstructured problem into smaller and tractable chunks, design automation becomes possible. In this paper we discuss the use of modularity and hierarchy for functional specialization during the development of neural networks. We study the behavioral differences and requirements for back-propagation training of feed-forward networks. Further we illustrate that a deliberate mix of hierarchically imposed evaluation functions will improve network accuracy and learning speed.

 

Files
EISSN 2619-9831