1 / 53

Chapter 13

Chapter 13 . ADVANCED INTELLIGENT SYSTEMS. Learning Objectives. Understand machine-learning concepts Learn the concepts and applications of case-based systems Understand the concepts and applications of genetic algorithms

doria
Download Presentation

Chapter 13

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript

  1. Chapter 13 ADVANCED INTELLIGENT SYSTEMS

  2. Learning Objectives • Understand machine-learning concepts • Learn the concepts and applications of case-based systems • Understand the concepts and applications of genetic algorithms • Understand fuzzy set theories and their applications in designing intelligent systems

  3. Learning Objectives • Understand the concepts and applications of natural language processing (NLP) • Learn the concepts, advantages, and limitations of voice technologies • Learn about integrated intelligent support systems

  4. Machine-Learning Techniques • Machine-learning concepts and definitions • Machine learning The process by which a computer learns from experience (e.g., using programs that can learn from historical cases)

  5. Machine-Learning Techniques • Human learning is a combination of many complicated cognitive processes including: • Induction (learning by example) • Deduction (specific inferences based on generalities) • Analogy (transference) • Other special procedures related to observing or analyzing examples

  6. Machine-Learning Techniques • How learning relates to intelligent systems • Learning systems demonstrate interesting learning behaviors • AI is not able to learn as well as humans or in the same way that humans • Machine learning cannot be applied in a creative way, although such systems can handle cases to which they have never been exposed • It is not clear why learning systems succeed or fail • A common thread running through most AI approaches to learning is the manipulation of symbols rather than numeric information

  7. Machine-Learning Techniques • Machine-learning methods • Supervised learning A method of training artificial neural networks in which sample cases are shown to the network as input and the weights are adjusted to minimize the error in its outputs • Unsupervised learning A method of training artificial neural networks in which only input stimuli are shown to the network, which is self-organizing

  8. Machine-Learning Techniques

  9. Inductive learning Case-based reasoning Neural computing Genetic algorithms Natural language processing (NLP) Cluster analysis Statistical methods Explanation-based learning A machine learning approach that assumes that there is enough existing theory to rationalize why one instance is or is not a prototypical member of a class Machine-Learning Techniques Machine-learning methods and algorithms

  10. Case-Based Reasoning (CBR) • Case-based reasoning (CBR) A methodology in which knowledge and/or inferences are derived from historical cases

  11. Case-Based Reasoning (CBR) • Analogical reasoning Determining the outcome of a problem with the use of analogies. A procedure for drawing conclusions about a problem by using past experience Suppose, for example, that I am thinking about buying a new car. I'm very likely to speak with other people who have recently bought new cars, noting their experiences with various makes, models, and dealers. If I discover that three of my friends have recently bought Brand X from ABC Dealership and that all three have been delighted with their purchases, then I will conclude by analogy that if I buy Brand X from ABC Dealership, I will be delighted, too. • Evaluating Analogical Reasoning • Number of instances, instance variety, # of similarities, relevance, # of dissimilarities, modesty of conclusion

  12. Case-Based Reasoning (CBR) • Inductive learning A machine learning approach in which rules are inferred from facts or data

  13. Case-Based Reasoning (CBR) • The basic idea and process of CBR • Four-step process • Retrieve • Reuse • Revise • Retain

  14. Case-Based Reasoning (CBR) • Definition and concepts of cases in CBR • Ossified cases Cases that have been analyzed and have no further value • Paradigmatic cases A case that is unique that can be maintained to derive new knowledge for the future

  15. Case-Based Reasoning (CBR) • Definition and concepts of cases in CBR • Stories Cases with rich information and episodes. Lessons may be derived from this kind of cases in a case base

  16. Case-Based Reasoning (CBR)

  17. Case-Based Reasoning (CBR) • Benefits and usability of CBR • CBR makes learning much easier and the recommendation more sensible

  18. Case-Based Reasoning (CBR) • Advantages of using CBR • Knowledge acquisition is improved. • System development time is faster • Existing data and knowledge are leveraged • Complete formalized domain knowledge is not required • Experts feel better discussing concrete cases • Explanation becomes easier • Acquisition of new cases is easy • Learning can occur from both successes and failures

  19. Case-Based Reasoning (CBR) • Uses, issues, and applications of CBR • Applications • CBR in electronic commerce • WWW and information search • Planning and control • Design • Reuse • Diagnosis • Reasoning

  20. Case-Based Reasoning (CBR) • Uses, issues, and applications of CBR • Implementation issues for designers • What makes up a case? How can we represent case memory? • Automatic case-adaptation rules can be very complex • How is memory organized? What are the indexing rules? • The quality of the results is heavily dependent on the indexes used

  21. Case-Based Reasoning (CBR) • Implementation issues for designers • How does memory function in relevant information retrieval? • How can we perform efficient searching (i.e., knowledge navigation) of the cases? • How can we organize the cases? • How can we design the distributed storage of cases? • How can we adapt old solutions to new problems? Can we simply adapt the memory for efficient querying, depending on context? What are the similarity metrics and the modification rules?

  22. Case-Based Reasoning (CBR) • Implementation issues for designers • How can we factor errors out of the original cases? • How can we learn from mistakes? That is, how can we repair and update the case base? • The case base may need to be expanded as the domain model evolves, yet much analysis of the domain may be postponed. • How can we integrate CBR with other knowledge representations and inferencing mechanisms? • Are there better pattern-matching methods than the ones we currently use? • Are there alternative retrieval systems that match the CBR schema?

  23. Case-Based Reasoning (CBR) • Success factors for CBR systems • Determine specific business objectives • Understand your end users and customers • Design the system appropriately • Plan an ongoing knowledge-management process • Establish achievable returns on investment (ROI) and measurable metrics • Plan and execute a customer-access strategy • Expand knowledge generation and access across the enterprise

  24. Genetic Algorithm Fundamentals • Genetic algorithms (GAs) Software programs that learn in an evolutionary manner similar to the way biological systems evolve

  25. Genetic Algorithm Fundamentals • Genetic algorithm process and terminology • Chromosome A candidate solution for a genetic algorithm • Reproduction The creation of new generations of improved solutions with the use of a genetic algorithm

  26. Genetic Algorithm Fundamentals • Genetic algorithm process and terminology • Crossover The combining of parts of two superior solutions by a genetic algorithm in an attempt to produce an even better solution • Mutation A genetic operator that causes a random change in a potential solution

  27. Genetic Algorithm Fundamentals

  28. Genetic Algorithm Fundamentals • A few parameters must be set for the genetic algorithm • Number of initial solutions to generate • Number of offspring to generate • Number of parents and offspring to keep for the next generation • Mutation probability (very low)

  29. Genetic Algorithm Fundamentals • Limitations of genetic algorithms • Not all problems can be framed in the mathematical manner that genetic algorithms demand • Development of a genetic algorithm and interpretation of the results requires an expert who has both the programming and statistical/mathematical skills demanded by the genetic algorithm technology in use • In some situations, the “genes” from a few comparatively highly fit (but not optimal) individuals may come to dominate the population, causing it to converge on a local maximum

  30. Genetic Algorithm Fundamentals • Limitations of genetic algorithms • Most genetic algorithms rely on random number generators that produce different results each time the model runs • Locating good variables that work for a particular problem is difficult • Selecting methods by which to evolve the system requires thought and evaluation

  31. Developing Genetic Algorithm Applications • GAs are a type of machine learning for representing and solving complex problems

  32. Dynamic process control Induction of optimization of rules Discovery of new connectivity topologies (e.g., neural computing connections, i.e., neural network design) Simulation of biological models of behavior and evolution Complex design of engineering structures Pattern recognition Scheduling Transportation and routing Layout and circuit design Telecommunication Graph-based problems Developing Genetic Algorithm Applications Applications of GAs include:

  33. Fuzzy Logic Fundamentals • Fuzzy logic Logically consistent ways of reasoning that can cope with uncertain or partial information; characteristic of human thinking and many expert systems. • Fuzzy sets A set theory approach in which set membership is less precise than having objects strictly in or out of the set

  34. Fuzzy Logic Fundamentals

  35. Fuzzy Logic Fundamentals • Fuzzy logic applications in manufacturing and management • Selection of stocks to purchase (e.g., the Japanese Nikkei stock exchange) • Retrieval of data (because fuzzy logic can find data quickly) • Inspection of beverage cans for printing defects • Matching of golf clubs to customers’ swings • Risk assessment • Control of the amount of oxygen in cement kilns • Accuracy and speed increases in industrial quality-control applications • Sorting problems in multidimensional spaces

  36. Fuzzy Logic Fundamentals • Fuzzy logic applications in manufacturing and management • Enhancement of models involving queuing (i.e., waiting lines) • Managerial decision support applications • Project selection • Environmental control building • Control of the motion of trains • Paper mill automation • Space shuttle vehicle orbiting • Regulation of water temperature in shower heads

  37. Natural Language Processing (NLP) • Natural language processing (NLP) Using a natural language processor to interface with a computer-based system • Two types of NLP • Natural language understanding • Natural language generation

  38. Natural Language Processing (NLP) • Some problems that make NLP difficult • Word boundary detection • Word sense disambiguation • Syntactic ambiguity • Imperfect or irregular input • Speech acts and plans

  39. Natural Language Processing (NLP) • The current NLP technology • Search and information retrieval • A person enters a certain phrase, word, or sentence on which to search the Internet or some database, and NLP is then used to construct the best query possible

  40. Natural Language Processing (NLP) • Applications of NLP • Human–computer interfaces • Abstracting and summarizing text • Analyzing grammar • Understanding speech

  41. Natural Language Processing (NLP) • Applications of NLP • Front ends for other software packages—querying a database that allows the user to operate the applications programs with everyday language • Text mining • FAQs and query answering

  42. Natural Language Processing (NLP) • Machine translation • Translation of content to other languages • Criteria used to assess machine translation • Intelligibility • Accuracy • Speed

  43. Voice Technologies • Voice technologies fall into three broad categories: • Voice (or speech) recognition • Voice (or speech) understanding • Text-to-voice (or voice synthesis)

  44. Voice Technologies • Voice (speech) recognition Translation of the human voice into individual words and sentences understandable by a computer • Speech understanding An area of AI research that attempts to allow computers to recognize words or phrases of human speech

  45. Voice Technologies • Advantages of voice technologies • Ease of access • Speed • Manual freedom • Remote access • Accuracy • Communicating while driving • Quick selection • Security • Cost benefit

  46. Voice Technologies • Limitations of speech recognition and understanding • Inability to recognize long sentences, or the excessive length of time needed to accomplish that understanding • High cost • Speech may need to be combined with keyboard entry, which slows communication

  47. Voice Technologies • Voice synthesis The technology by which computers convert text-to-voice (speak) • A text-to-speech system is composed of two parts: • Front end takes input in the form of text and outputs a symbolic linguistic representation • Back end takes the symbolic linguistic representation as input and outputs the synthesized speech waveform

  48. Voice Technologies • Voice technology applications • Call center • Contact of customer care center • Computer/telephone integration (CTI) • Interactive voice response (IVR) • Voice portal • Voice over IP (VoIP)

  49. Voice Technologies • Voice portals Web sites, usually portals, with audio interfaces

  50. Developing Integrated Advanced Systems • Fuzzy neural networks • Fuzzification A process that converts an accurate number into a fuzzy description, such as converting from an exact age into young or old • Defuzzification Creating a crisp solution from a fuzzy logic solution

More Related