1 / 27

Using data sets to simulate evolution within complex environments

Using data sets to simulate evolution within complex environments. Bruce Edmonds Centre for Policy Modelling Manchester Metropolitan University. Main Issue. Does the complexity of the environment significantly affect evolutionary processes?

macon-park
Download Presentation

Using data sets to simulate evolution within complex environments

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Using data sets to simulate evolution within complex environments Bruce EdmondsCentre for Policy ModellingManchester Metropolitan University

  2. Main Issue • Does the complexity of the environment significantly affect evolutionary processes? • Where “complexity” means that there are exploitable patterns in the environment but these are difficult to discover • Adding randomness to an environment and/or fitness is not satisfactory • NK model of fitness adjusts the difficulty of a fitness space (second order uniformity) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 2

  3. Idea of Talk • Evolutionary data-mining is where ideas from biological evolution are applied to data-mining – finding patterns in data • Data sets exist for the purpose of testing different ML algorithms that have patterns in them, albeit difficult to discover • Reversing this... I am suggesting the use of complex data sets as a test bed to investigate how the complexity of the environment might affect evolution Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 3

  4. The Data Set Environment • Find a rich data set (preferably one derived from a naturally complex system) with many independent variables • The gene of an individual is an arbitrary arithmetic expression stored as a tree (or similar technique) • Resource in the model is modelled by distributing to individuals predicting the outcome variable of local data better than its competitors • The gene are mutated and crossed as the simulation progresses • Individuals are selected for/against depending on their total success in predicting Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 4

  5. Cleveland Heart Disease Data • 281 Data Points • 13 Diagnostic variables: age, sex, cp (chest pain), trestbps (resting blood pressure), chol (cholesteral), fbs (fasting blood sugar), restecg (resting ecg type), thalach (max heart rate), exang (exercise induced angina), oldpeak (ST depression induced by exercise), slope (slope of exercise), ca (num blood vessels), thal • Predicts severity of Heart Attack (0-4) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 5

  6. The Evolutionary Model I Data Space For each data point (or a random subset of them) evaluate (a random selection of) near individuals to determine the share of fitness each receive (depending on predictive success) Sum of fitness determines which breed and die 1.1 3.7 Individuals each with genes composed of an arithmetic expression to predict HD based on the other 13 variables 0.8 Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 6

  7. The Evolutionary Model II Data Space 15.5 12.5 • N times: • probabilistically select a winner on fitness • probabilistically select a loser on lack of fitness • kill loser • Either • propagate winner locally with possible mutation • mate with another local based on fitness 3.2 17.6 23.7 12.3 8.6 9.0 8.1 Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 7

  8. Start of Simulation (HD Data) Data points from set distributed over space dependent on 2 variables chol (x) & thalach (y) Individuals each with gene which is an arithmetic expression, e.g.: Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 8

  9. After 25 ticks (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 9

  10. After 50 ticks (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 10

  11. After 75 ticks (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 11

  12. After 300 then 100 w/o Variation 1 ca sex slope fbs/oldpeak restecg+fbs+1 Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 12

  13. Illustrative Results • Heart Disease Data Set • 20 runs with each setting • 1000 individuals, 1000 iterations • Locality parameter 0.1 (radius) • Comparison of Original vs Ersatz Data Sets • Fixed normal noise (0, 0.1) added to both data sets Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 13

  14. Ersatz Data Set • Comparison Data Set • For each variable separately: approximate a normal distribution of its values • Then reconstruct a data set using this distribution for each value independently • Results in a Data Set with similar shape and randomness • But without the predictive variable being linked in to the explanatory variables Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 14

  15. Fitness (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 15

  16. Spread (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 16

  17. Gene Complexity/Depth (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 17

  18. All Runs’ Complexity Original Ersatz Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 18

  19. Fitness (White Wine Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 19

  20. Depth (White Wine Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 20

  21. Depth (White Wine Data) Original Original with 0.1 noise Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 21

  22. Depth – locality 0.1 (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 22

  23. Depth – locality 0.2 (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 23

  24. Depth – locality 0.4 (HD Data) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 24

  25. Concluding Questions • When mighty the complexity of the environment effect evolutionary processes? • How might the complexity of the environment effect evolutionary processes? • Will models with a simple environment tell us about evolution in the wild? • When and about what aspects will models with simple environments be sufficient? • In what ways might evolution differ when in complex environments? • What kind of complexity might we need? • How might one measure this complexity in the wild (if this is even possible)? Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 25

  26. The End Bruce Edmonds http://bruce.edmonds.name Centre for Policy Modelling http://cfpm.org

  27. White Wine Quality Data • 4898 Data Points • 11 Diagnostic variables: fixed acidity, volatile acidity, citric acid, residual sugar, chlorides, free sulfur dioxide, total sulfur dioxide, density, pH, sulphates, alcohol • Predicts judged quality of wine (0-10) Using data sets to simulate evolution, Bruce Edmonds, Complexity of Evolutionary Processes, Manchester, June 13th 2011, slide 27

More Related