1 / 30

A Data Simulation System Using sinx/x and sinx Polynomial Higher Order Neural Networks

A Data Simulation System Using sinx/x and sinx Polynomial Higher Order Neural Networks. Dr. Ming Zhang Department of Physics, Computer Science and Engineering College of Liberal Arts and Sciences Christopher Newport University. This research is supported by

nanji
Download Presentation

A Data Simulation System Using sinx/x and sinx Polynomial Higher Order Neural Networks

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. A Data Simulation System Using sinx/x and sinx Polynomial Higher Order Neural Networks Dr. Ming Zhang Department of Physics, Computer Science and Engineering College of Liberal Arts and Sciences Christopher Newport University This research is supported by Christopher Newport University 2004 Summer Stipend grant CNU Applied Research Centre 2004 research funding.

  2. SUMMARY • Traditional methods of data simulation are high inaccurate. • The solution to choice of the optimal neural network model for simulation and prediction is still not found. • In this paper a data simulation system based on the sinx/x and sinx Polynomial Higher Order Neural Network (SXSPHONN) has been developed. • The paper also proved that SXSPHONN models are convergence when simulate XOR data. • Rainfall data has been tested in the paper. • SXSPHONN model is 0.999% better than Polynomial Higher Order Neural Network (phonn) model and 0.967% batter than Trigonometric Polynomial Higher Order Neural Network (thonn) model in our rainfall case.

  3. 1 INTRODUCTION (1) • Currently, satellite derived precipitation estimates [1] and 3 hour precipitation outlooks for extra-tropical cyclones, and tropical cyclones are computed on the NOAA/NESDIS Interactive Flash Flood Analyser (IFFA) system and transmitted to National Weather Service Forecast Offices, and River Forecast Centres.

  4. 1 INTRODUCTION (2) • Artificial neuron network-based models are not yet sufficiently powerful to characterize complex systems. Moreover, a gap exists in the research literature between complex systems and general systems. To characterize complex systems, neuron-based and neural network-based group models are studied.

  5. 1 INTRODUCTION (3) • Zhang, Murugesan, and Sadeghi (1995) developed a Polynomial Higher Order Neural Network (PHONN)[12] for data simulation. Ming Zhang, Jing Chun Zhang, and Steve Keen [13] developed a Trigonometric Polynomial Higher Order Neural Network (THONN) system for higher frequency non-linear data simulation and prediction. Lu and Zhang [14] developed a model, called Polynomial and Trigonometric polynomial Higher Order Neural Network (PT-HONN).

  6. 1 INTRODUCTION (4) • This paper will develop a new higher order neural network model called sinx/x and sinx Polynomial Higher Order Neural Network(SXSPHONN) model. The sinx/x and sinx functions have been used as neuron activity functions. • For testing SXSPHONN model, a SXSPHONN simulator has been built. • XOR data will be used to test SXSPHONN model convergence. • The comparison experimental results between PHONN, THONN and SXSPHONN models for heavy rainfall estimation will be studied here.

  7. 2 SXSPHONN MODEL (1) • The network architecture of SXSPHONN is developed based on the characteristics of THONN models. • The different part of SXSPHONN is, SXSPHONN used sinx/x and sinx functions for the neurons. • It is a multi-layer network that consists of an input layer with input-units, and output layer with output-units, and two hidden layers consisting of intermediate processing units.

  8. 2 SXSPHONN MODEL (2) • The specify definition of SXSPHONN is presented in the following:

  9. 2 SXSPHONN MODEL (3) • For a output layer neuron, we have:

  10. 2 SXSPHONN MODEL (4) • For the hidden layer neurons, the weight update equations are formulated as follows:

  11. 2 SXSPHONN MODEL (5)

  12. 3. SXSPHONN SIMULATOR

  13. 4. XOR TEST (1)

  14. 4. XOR TEST (2) XOR Input Graph

  15. 4. XOR TEST (3) XOR Convergence (12628 epochs)

  16. 4. XOR TEST (4) Weights for XOR

  17. 4. XOR TEST (5) XOR Final Report from SXSPHONN Simulator

  18. 5.HEAVY RAINFALL ESTIMATING (1) Cloud Top Temperature, Cloud Growth, and Rainfall Inches

  19. 5.HEAVY RAINFALL ESTIMATING (2) SXSPHONN: Rainfall Input Data Graph

  20. 5.HEAVY RAINFALL ESTIMATING (3) SXSPHONN: Rainfall Data Convergence (1000 Epochs)

  21. 5.HEAVY RAINFALL ESTIMATING (4) SXSPHONN: Weights for Rainfall

  22. 5.HEAVY RAINFALL ESTIMATING (5) SXSPHONN: Rainfall Estimation Report

  23. 5.HEAVY RAINFALL ESTIMATING (6) PHONN: Rainfall Data Convergence

  24. 5.HEAVY RAINFALL ESTIMATING (7) PHONN: Rainfall Estimation Report

  25. 5.HEAVY RAINFALL ESTIMATING (8) THONN: Rainfall Data Convergence

  26. 5.HEAVY RAINFALL ESTIMATING (9) THONN: Rainfall Estimation Result

  27. 6. CONCLUSION • SXSPHONNmodels are studied in this paper. • Using SXSPHONN model, heavy rainfall estimation could have better results than PHONN and THONN higher order neural network model. • As the next step, the research will more focus on developing automatic higher order neural network models.

  28. ACKNOWLEDGE • The author would like to thank Prof. Douglas Gordon, Dean of College of Liberal Arts and Science CNU, and Prof. A. Martin Buoncristiani, Chair of Department of Physics, Computer Science and Engineering CNU, for their great support and funding.

  29. REFERENCE • R. A. Scofield, The NESDIS operational convective precipitation estimation technique, Monthly Weather Review, 115, 1982, 1773-1792. • Vicente, G., Scofield, R. A., and Menzel, W. P., The operational GOED infrared rainfall estimation techniques, Bulletin of the American Meteorological Society, 79(9), 1998,1883-1898. • D. R. Lippmann, An introduction to computing with neural nets, IEEE Acoustics, Speech and Signal Processing, 4 (2), 1987, 4-22. • T. Tsao, A group theory approach to neural network computing of 3D rigid motion. Proc. Intl. Joint Conf. Neural Networks. 2, 1989, 275-280. • L. Vecci, F. Piazza, A. Uncini, Learning andapproximation capabilities of adaptive spline activation function neural networks, Neural Networks, 11, 1998, 259-270. • C. T. Chen, W. D. Chang, A feedforward neural network with function shape autotuning, Neural Networks, 9(4), 1996, 627-641. • P. Campolucci, F. Capparelli, S. Guarnieri, F. Piazza, & A. Uncini, Neural networks with adaptive spline activation function. Proceedings of IEEE MELECON 96, Bari, Italy, 1996, 1442-1445.

  30. Thanks!

More Related