1 / 16

Computational Intelligence Winter Term 2012/13

Computational Intelligence Winter Term 2012/13. Prof. Dr. Günter Rudolph Lehrstuhl für Algorithm Engineering (LS 11) Fakultät für Informatik TU Dortmund. Swarm Intelligence. Contents. Ant algorithms (combinatorial optimization) Particle swarm algorithms (optimization in R n ).

emmet
Download Presentation

Computational Intelligence Winter Term 2012/13

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Computational Intelligence Winter Term 2012/13 Prof. Dr. Günter Rudolph Lehrstuhl für Algorithm Engineering (LS 11) Fakultät für Informatik TU Dortmund

  2. Swarm Intelligence Contents • Ant algorithms (combinatorial optimization) • Particle swarm algorithms (optimization in Rn) G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 2

  3. concepts: ● evaluation of own current situation ● comparison with other conspecific ● imitation of behavior of successful conspecifics Swarm Intelligence metaphor swarms of bird or fish seeking for food ants or termites seeking for food concepts: ● communication / coordination by means of „stigmergy“ ● reinforcement learning → positive feedback  audio-visual communication  olfactoric communication G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 3

  4. Swarm Intelligence ant algorithms (ACO: Ant Colony Optimization) paradigm for design of metaheuristics for combinatorial optimization stigmergy = indirect communication through modification of environment »1991 Colorni / Dorigo / Maniezzo: Ant System (also: 1. ECAL, Paris 1991) Dorigo (1992): collective behavor of social insects (PhD) some facts: • about 2% of all insects are social • about 50% of all social insects are ants • total weight of all ants = total weight of all humans • ants populate earth since 100 millions years • humans populate earth since 50.000 years G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 4

  5. nest food nest food Swarm Intelligence double bridge experiment (Deneubourg et al. 1990, Goss et al. 1989) initially:both bridges used equally often finally:all ants run over single bridge only! finally:all ants use the shorter bridge! G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 5

  6. positive feedbackloop Swarm Intelligence • How does it work? • ants place pheromons on their way • routing depends on concentration of pheromons more detailed: ants that use shorter bridge return faster )pheromone concentration higher on shorter bridge )ants choose shorter bridge more frequently than longer bridge )pheromon concentration on shorter bridge even higher )even more ants choose shorter bridge )a.s.f. G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 6

  7. Swarm Intelligence • Ant System (AS) 1991 combinatorial problem: • components C = { c1, c2, ..., cn } • feasible set F µ 2C • objective function f: 2C→R ants = set of concurrent (or parallel) asynchronous agents move through state of problems partial solutions of problems )caused by movement of ants the final solution is compiled incrementally G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 7

  8. ‘trails‘ paths ‘attractiveness‘ excitement, stimulus feedback Swarm Intelligence movement: stochastic local decision (2 parameters) • while constructing the solution (if possible), otherwise at the end: • evaluation of solutions • modification of ‘trail value‘ of components on the path G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 8

  9. Swarm Intelligence • ant k in state i • determine all possible continuations of current state i • choice of continuation according to probability distribution pij pij = q( attractivity, amount of pheromone ) heuristic is based on a priori desirability of the move a posteriori desirability of the move„how rewarding was the move in the past?“ • update of pheromone amount on the paths: as soon as all ants have compiled their solutions good solution % increase amount of pheromone, otherwise decrease & G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 9

  10. Swarm Intelligence Combinatorial Problems (Example TSP) • TSP: • ant starts in arbitrary city i • pheromone on edges (i, j): ij • probability to move from i to j: • ij = 1/dij ; dij = distance between city i and j •  = 1 and 2 [2, 5] (empirical), 2 (0,1) “evaporation rate“ • Ni(t) = neighborhood of i at time step t (without cities already visited) • update of pheromone after  journeys of ants: • ij(k) = 1 / (tour length of ant k), if (i,j) belongs to tour G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 10

  11. Swarm Intelligence • two additional mechanisms: • trail evaporation • demon actions (for centralized actions; not executable in general) Ant System (AS) is prototype tested on TSP-Benchmark → not competitive )but: works in principle! • subsequent: 2 targets • increase efficiency (→ competitiveness with state-of-the-art method) • better explanation of behavior 1995 ANT-Q (Gambardella & Dorigo), simplified: 1996 ACS ant colony system G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 11

  12. Swarm Intelligence Particle Swarm Optimization (PSO) abstraction from fish / bird / bee swarm paradigm for design of metaheuristics for continuous optimization developed by Russel Eberhard & James Kennedy (~1995) • concepts: • particle (x, v) consists of position x 2Rn and “velocity” (i.e. direction) v 2Rn • PSO maintains multiple potential solutions at one time • • during each iteration, each solution/position is evaluated by an objective function • • particles “fly” or “swarm” through the search space to find position of an extremal value returned by the objective function G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 12

  13. Swarm Intelligence PSO update of particle (xi, vi) at iteration t 1st step: const. const. const. random variable random variable best solution among all solutions up to iteration t ≥ 0 best solution among all solutions of iteration t ≥ 0 G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 13

  14. Swarm Intelligence PSO update of particle (xi, vi) at iteration t 1st step: new direction old direction direction from to direction from to G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 14

  15. Swarm Intelligence PSO update of particle (xi, vi) at iteration t 2nd step: Note thesimilaritytotheconceptofmutativestepsizecontrol in EAs: firstchangethestepsize (direction), thenusechangedstepsize (direction) forchangingposition. new position new direction old position G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 15

  16. Swarm Intelligence • More swarm algorithms: • - Artificial Bee Colony • - Krill Herd Algorithm • - Firefly Algorithm • Glowworm Swarm • ... But be watchful: Is there a new algorithmic idea inspired from the biological system? Take a look at the code / formulas: Discover similarities & differences! Often: “Old wine in new skins.“ G. Rudolph: Computational Intelligence ▪ Winter Term 2012/13 16

More Related