220 likes | 235 Views
Explore three existing approaches to evolutionary robotics for optimizing robot behavior in manufacturing and construction. Learn about their advantages, challenges, and the alternative Estimation-Exploration Algorithm (EEA) approach.
E N D
Evolutionary robotics approaches Evolve the controller of a robot to automatically discover (near-)optimal behavior Three existing approaches to evolutionary robotics: Evolve controllers directly on a physical robot. Requires 100s or 1000s of physical evaluations. Create a simulation of the robot, and perform some or all of controller evolution in simulation before transferal to the physical device. Requires a human to hand craft the simulator; “Reality gap” problem. Adapt controllers on the physical robot from an original, hand-created controller Requires a human to hand craft the original controller.
Evolutionary robotics approaches Evolve the controller of a robot to automatically discover (near-)optimal behavior Three existing approaches to evolutionary robotics: Evolve controllers directly on a physical robot. Requires 100s or 1000s of physical evaluations. Create a simulation of the robot, and perform some or all of controller evolution in simulation before transferal to the physical device. Requires a human to hand craft the simulator; “Reality gap” problem. Adapt controllers on the physical robot from an original, hand-created controller Requires a human to hand craft the original controller. Alternative approach—The Estimation-Exploration Algorithm (EEA):
Typical experiment Motor 5 Motor 1
Evaluating candidate self-models Does not tilt Tilts to the right Does not tilt Higher error Lower error
The Estimation-Exploration Algorithm (EEA) applied to a single robot Phenotype: Fitness: Estimation Exploration Phenotype: Fitness: Exploitation
Intelligent testing: 13 out of 30 runs prodeuce successful models
Generating behaviors using an optimized model 0.0s 1.3s 1.9s 2.1s 2.3s 2.6s 3.1s 3.7s 4.0s 4.9s 5.2s 4.5s