Multi-Valued Neuron with Sigmoid Activation Function

1. Multi-Valued Neuron with Sigmoid Activation Function Shin-Fu Wu 2013/5/10

2. Outlines • Multi-Valued Neuron (MVN) • MVN with Sigmoid Activation Function (MVN-sig) • Motivation and Expectation • Multi-Valued Sigmoid Activation Function • Learning using Back-propagation Rule • Simulation Results • Benchmark simulations • Problems and Limitations • Movement of Weighted Sum • Future Works

3. MVN

4. MVN-sig • Motivation and Expectation • Basic idea: approach the functionality of MVN using sigmoid function • Differentiable • Multi-Valued Logic • Expectation: • Better performance and tolerance • More execution time

5. MVN-sig

6. MVN-sig

7. MVN-sig

8. MVN-sig

9. MVN-sig

10. MVN-sig

11. Simulation Results • Benchmark Simulations • Wine dataset (5-fold CV, 100% trained)

12. Simulation Results • Glass identification dataset (5-fold CV, 100% trained)

13. Simulation Results

14. Simulation Results

15. Future Works