1 / 5

Optimal Brain Surgeon Algorithm

Optimal Brain Surgeon Algorithm. Payne Y. Chang. What is OBS(Optical Brain Surgeon) ?. To solve real-world problems with ANN : Usually Need Highly connected Larger Not alwayse good. OBS algorithm An approach to prune the ANN

yolandawilkins
Download Presentation

Optimal Brain Surgeon Algorithm

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Optimal Brain Surgeon Algorithm Payne Y. Chang

  2. What is OBS(Optical Brain Surgeon) ? • To solve real-world problems with ANN : • Usually Need • Highly connected • Larger • Not alwayse good • OBS algorithm • An approach to prune the ANN • Goal : 1. Set some synaptic weights to zero 2. Modify the remaining weights 3. Maintain good performance

  3. How does OBS work ? 1. Train the MLP 2. Calculate the saliency ( Si ) of each synaptic weight ( wi ) Si : The increase in the cost function from the deletion of wi 3. If Si is smaller than a threshold, delete wi 4. Go to step 2 5. Stop when no more weights can be deleted

  4. Program : OBS.exe 1. C++ 2. FLTK Input Output Hidden N Bias (1) Deleted w

  5. Results and Summary • Learning Rate = 0.01 • Momentum = 0.8 • Activation function : Hyperbolic tangen 1. Efficient ( Time & Storage Saving ) 2. Better Generalization

More Related