1 / 95

Peter van Lith

Peter van Lith Embedded Intelligence Embedded Intelligence The Technology What are Embedded Processors and Why Processor Families Application Areas Facilities I/O Systems Trends Embedding Intelligence Typical problems Applications RoboCup, Aibo and Camera’s Overview

johana
Download Presentation

Peter van Lith

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Peter van Lith Embedded Intelligence

  2. Embedded Intelligence • The Technology • What are Embedded Processors and Why • Processor Families • Application Areas • Facilities • I/O Systems • Trends • Embedding Intelligence • Typical problems • Applications • RoboCup, Aibo and Camera’s

  3. Overview What is different about embedded processors • What are Embedded Processors • Processor Families • Application Areas • Facilities • I/O Systems • Trends

  4. Introduction • What is it • Small computers • Controllers • Why Embedded processors • Size, weight, Power consumption, Simplicity / Reliability • Cost • Real-time • How to embed intelligence • Usually with PC / Notebook • Consumes much energy / space • Also use of PLC’s • Distributed model functions more flexibly • Use of hardware agents

  5. Embedded Intelligence What it is NOT • The kind of intelligence in • Intelligent Terminals vs • Dumb Terminals • Applied AI in smaller processors

  6. Applications Number of processors considerably larger than PC’s, medium and mainframe computers together • Stand Alone • PDA, Games, Remote Control • Peripheral Controllers • Keyboards, TV, Video, Radio, Machines • Complex • Cars, Process Control • Networked • Telephone, Web Interface, Printers, Coffee machines • Ad-Hoc - Sensor Nets, Swarms, Dust • Micro • Smart Cards, Smart Tags • Autonomous • AGV’s, Robots, Aibo, RoboCup, Rescue, RoboSail

  7. Embedded Families • PC Based • Interpreters • C/C++ • OS Based • Symbian, WinCE, WinXP Embedded, Linux • DragonBall, Arm, StrongArm • PC 104 • J2ME – cldc, cdc • Stand Alone • 8051, HC11, ST6, H8, Pic • Interpreters • Basic Stamp • Java Stamp, TStik (Tini) • JCX • Lego Brick (H8) • JCX Interfaces • Java processors • JStik, JStamp

  8. Applications • Historical growth • Mainframes - N : 1 • PCs - 1 : 1 • Embedded - 1 : N • The software problem • Hardware used to be reliable • Simple • Clear interfaces • Growing software unreliability • Testing of interfaces

  9. Facilities • Protection • Power Management • Memory • Architecture • Bus Architectures / Interfacing • Level converters • In Circuit • Speed

  10. Facilities Protection • Power Management, • Brownout • Watchdogs • Code Protection Power Management • Speed control • Sleep mode • Function switchoff Memory • EEProm, Flash • On Chip RAM, Off Chip RAM/Flash • Bank switching • Memory Mapped I/O

  11. Facilities Architecture • RISC, CISC, Harvard, von Neumann • Small Footprint • Multiply/Divide • Array Functions • DSP Functions • Level Comparator • AD/DA converters Bus Architectures / Interfacing • Chip Select • Data and Address Bus • High Speed and Low Speed busses • Peripheral interfaces

  12. Facilities Level converters • TTL 5v • CMOS 3.3 v, 1.3 v • Differences in logic levels In Circuit • Programming (ICP) • Debugging (ICD) • Emulation (ICE) Speed • Crystal divide • Phase Lock Loop • Idle Loop • Clock speed variation • Overclocking

  13. Interfaces Inter Procesor • SPI, I2C, One Wire, Parallel, Serial Testing • Boundary Scan, JTAG, ICD, ICE Inter-System • Serial, TCP/IP, USB • Wireless • RF, IrDa, WiFi, BlueTooth, ZigBee • Sensor Networks Inter-Chip • SPI, I2C, On-Chip networking

  14. I/O Systems • I/O types • Switches • Sensors • Displays • Sound • Actuators

  15. I/O Systems - Inputs Switches • Keyboards • Touch Screens • Contact switches • Magnetic switches

  16. I/O Systems - Sensors • Optical Encoders • Magnetic Sensors • Hall Effect, Magneto Resistive • Optical Sensors • IR, PIR, LDR • Image Sensors • Arrays, Camera chips • Sound Sensors • Microphones, Piezo sensors • Ultrasonic sensors • Gas Sensors • CO, CO2 • Other • Temp, Wind, Humidity, Strain gauges

  17. I/O Systems - Output Displays • LEDs • 7 Segment Displays • LCD Displays • COG Displays Sound • Beepers • Speaker Systems • Speech chips • Speech recognition chips

  18. I/O Systems - Actuators Motors • Motor Controllers • Stepper Motors • DC Motors Power Drivers Valves, Pneumatic, Hydrolic Relays, Solenoids

  19. Power Management Power systems • Mains, Battery, Solar • Battery Systems • Lead Acid, NiCad, NiMh, LiOn, Polymer, Fuel Cell • Regulators • Step Down, Step Up, Switching

  20. Trends • Embedded Logic • Asics • CPLD’s • Hybrids • Configurable Logic • FPGA’s • VHDL, JHDL • On-Chip networks

  21. New Hardware Logic ASICs – Application Specific Integrated Circuits • Development of IC is very expensive (> 1 mi$) • Takes a long development cycle • Development done with VHDL (Very hi speed ic Hardware Definition Language) • GAL – Gate Array Logic • CPLD – Custom Programmable Logic Devices • FPGA – Field Programmable Gate Arrays • RAW - Random Access Wiring project at MIT

  22. FPGA • FPGA consists of Gate Arrays, which has: • DLL - Delayed Locked Loop for clock timing • RAM – Block RAM • IOB – IO Blocks • CLB – Configurable Logic Block

  23. CLB • Configurable Logic Block uses: • LUT – Lookup Table to define functions • MUX - Multiplexers to connect input pins to Gate Arrays

  24. Logic Block • Logic is defined just as with discrete hardware components • Process the same as creation of PCB and IC • Many tested IP components available • Compiled into VHDL to generate layout • JHDL version to define logic in Java • Compilers to transform C into VHDL

  25. Embedded Intelligence Conventional • State Machines • Heartbeat • PID controllers • Sensors and actuators Advanced • Fuzzy Logic • Subsumption • Sensor fusion • Organic growth • Neural Nets High level programming • Patterns • Virtual Machines

  26. Subsumption • Development of complex systems often requires several generations • Each generation requires a redesign • Restructuring causes incompatibility Rodney Brooks (MIT) developed an architecture that allows evolutionary development • Once a components works it is not changed any more • New functionality is added on top of existing structure

  27. Avoid Walk Leg Up Leg Down Vertical Position Leg Forward Vertical Balance Horizontal Position Subsumption architecture

  28. Emergent properties A new combination of existing properties that prove useful for something unexpected • School of fish / Swarms • Cockroaches • Birds / feathers Something for nothing Side effects that have a life or their own

  29. Embedded Intelligence Control Issues • Localization, odometry • Grounding • Path planning • Goals and beliefs • Conflicts • Noise Desirable interfaces • Camera Systems • Image Analysis • Sensor processing • Sampling • Sensor fusion • Sensor networks

  30. Understanding Understanding Braitenberg’s Vehicles Most people give an explanation of the behavior that is more complex than the internal structure deserves Angry Afraid Admiration Curious

  31. The need for intelligence • A robot needs to make its own decisions • It needs to recognize and understand its environment • It needs to be able to communicate • With people • With other robots • It needs to move around in its environment • It needs to adapt to its environment

  32. Movement and Reaction

  33. Current possibilities • What can we do today • Only limited applications • Even simple interaction is problematic • Embodiment is important • Honda Robot • Sony Aibo and Pino • NEC PaPeRo • IS Robotics My Real Baby

  34. Examples of applications • Asimo, primarily for demonstrations • Walks statically • Requires prepared environment • 140 cm • Sony bipeds QRIO • Static and pseudo-dynamic walk • Many sensors • 60 cm

  35. Embedded Intelligence • The Technology • What are Embedded Processors and Why • Processor Families • Application Areas • Facilities • I/O Systems • Trends • Embedding Intelligence • Typical problems • Applications • RoboCup, Aibo and Camera’s

  36. Overview How to use in intelligent systems • Typical problems • Robot types • Autonomous Robots • Interactive Robots • Cooperating Robots • Walking Robots • Humanoids • The Projects • Aibo and RoboCup • Intelligent Camera

  37. Autonomous Robots Two approaches: • Top Down (1960 – 1986) • Using reasoning • Goal directed behavior • Model building and planning • Bottom Up (1986 – now) • Using reactive behaviors • No models

  38. The need for intelligence • A robot needs to make its own decisions • It needs to recognize and understand its environment • It needs to be able to communicate • With people • With other robots • It needs to move around in its environment • It needs to adapt to its environment

  39. The first robots Shakey (1966) • Received commands like SHRDLU • Needed to reason about every command • Used large external computer • Took a long time to execute every command • Used Reasoning and Planning

  40. Embedded Intelligence - Typical problems Problem areas are too simple • Optimal configuration solves the problem • ScareCrow • Sensorman • Deep Blue • PID controllers AI component is always very small • Infrastructure problems are major • Construction and sensor processing • Fixed behaviour • Very difficult to integrate

  41. The problem must be demanding ScareCrow (David Miller JPL) • Won the 1992 AAAI robot competition • Had only relays and some contact switches • Won by speed and brute force

  42. The Sensorman • Infra Red sensors • Video camera • Stereo video camera • Stereo video color camera • Infra Red sensors So: The simpler the sensor, the better

  43. Sense Reason Act Sense – Reason - Act • Sense • Get input from the world • Reason • World modelling • Reasoning, Decisions • Act • Output to the world • Interaction with the world

  44. Behavior • ProActive Behavior • Planning • Goals • Beliefs • ReActive Behavior • Curiosity / Fright-or-Flight • Obstacle avoidance

  45. Acting • Strategies • Reasoning • Neural Nets • Genetic Algorithms • Decision Trees, Augmented State Machines • Negotiation

  46. Big Issues • The Frame Problem • Get the object from the room • Noticing • Remembering

  47. Controversy • Analog vs Digital • The travelling salesman • Hardware networks • Physical vs Virtual • Stored program computer is a virtual network • Parallel vs Serial • Massively Parallel Machines • Still slower than network

  48. Robot insects • Construction of artificial organisms in hardware • Evolutionary development. Layered architecture. No redesigns. • Minimal control. No central processing and as much as possible reactive systems • Use emergent principles where possible

  49. Robot Insects Crawling is an emergent property

  50. The need for intelligence • A robot needs to make its own decisions • It needs to recognize and understand its environment • It needs to be able to communicate • With people • With other robots • It needs to move around in its environment • It needs to adapt to its environment

More Related