1 / 6

GMDH-type neural networks

GMDH-type neural networks. GMDH. Inductive Learning Algorithms for Complex Systems Modeling Alexey G. Ivakhnenko (1994) Group Method of Data Handling Inductive learning “Survival of the fittest” Fully automatic structural “Self-organization” “external criterion”

nola
Download Presentation

GMDH-type neural networks

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. GMDH-type neural networks

  2. GMDH • Inductive Learning Algorithms for Complex Systems Modeling • Alexey G. Ivakhnenko(1994) • Group Method of Data Handling • Inductive learning • “Survival of the fittest” • Fully automatic structural • “Self-organization” • “external criterion” • Parametric optimization

  3. Unit neuron • Polynomial neural networks • Solving the nonlinear problem using polynomial instead of linear combination. • Kolmogorov-Gabor polynomial

  4. Weight update: Back propagation: 1-hidden-layer:f(XW) 2-hidden-layer:f(f(XU)W) W U Error ε

  5. External Criterion • Principle of self-organization • Regularity criterion • It consists of a squared error from testing set B • Symmetric Regularity criterion delta A: training set B: testing set Δ(): external criterion Δ(B) ε(A+B) Global minimum complexity

  6. Initial model selection Optimal estimation External criterion

More Related