Subset based training and pruning of sigmoid neural networks

Guian Zhou, Jennie Si

Research output: Chapter in Book/Report/Conference proceedingConference contribution


In the present paper we develop two algorithms, Subset Based Training (SBT) and Subset Based Training and Pruning (SBTP), using the fact that the Jacobian matrices in sigmoid network training problems are usually rank deficient. The weight vectors are divided into two parts during training, according to the Jacobian rank sizes. Both SBT and SBTP are trust region methods. Comparing to the standard Levenberg-Marquardt (LM) method, these two algorithms can achieve similar convergence properties as the LM but with less memory requirements. Furthermore the SBTP combines training and pruning of a network into one comprehensive procedure. Some convergence properties of the two algorithms are given to qualitatively evaluate the performance of the algorithms.

Original languageEnglish (US)
Title of host publicationProceedings of the 1998 American Control Conference, ACC 1998
Number of pages5
StatePublished - 1998
Event1998 American Control Conference, ACC 1998 - Philadelphia, PA, United States
Duration: Jun 24 1998Jun 26 1998

Publication series

NameProceedings of the American Control Conference
ISSN (Print)0743-1619


Other1998 American Control Conference, ACC 1998
Country/TerritoryUnited States
CityPhiladelphia, PA

ASJC Scopus subject areas

  • Electrical and Electronic Engineering


Dive into the research topics of 'Subset based training and pruning of sigmoid neural networks'. Together they form a unique fingerprint.

Cite this