1 / 52

CPSC 540 Machine Learning

CPSC 540 Machine Learning. Nando de Freitas. http://www.cs.ubc.ca/~nando/540-2007. Acknowledgement. Many thanks to the following people for making available some of the slides, figures and videos used in these slides: Kevin Murphy (UBC) Kevin Leyton-Brown (UBC) Tom Griffiths (Berkeley)

xiang
Download Presentation

CPSC 540 Machine Learning

An Image/Link below is provided (as is) to download presentation Download Policy: Content on the Website is provided to you AS IS for your information and personal use and may not be sold / licensed / shared on other websites without getting consent from its author. Content is provided to you AS IS for your information and personal use only. Download presentation by click this link. While downloading, if for some reason you are not able to download a presentation, the publisher may have deleted the file from their server. During download, if you can't get a presentation, the file might be deleted by the publisher.

E N D

Presentation Transcript


  1. CPSC 540Machine Learning Nando de Freitas http://www.cs.ubc.ca/~nando/540-2007

  2. Acknowledgement • Many thanks to the following people for making available some of the slides, figures and videos used in these slides: • Kevin Murphy (UBC) • Kevin Leyton-Brown (UBC) • Tom Griffiths (Berkeley) • Josh Tenenbaum (MIT) • Kobus Barnard (Arizona) • All my awesome students at UBC

  3. Introduction to machine learning • What is machine learning? • How is machine learning related to other fields? • Machine learning applications • Types of learning • Supervised learning • regression • classification • Unsupervised learning • clustering • data association • abnormality detection • dimensionality reduction • structure learning • Semi-supervised learning • Active learning • Reinforcement learning and control of partially observed Markov decision processes.

  4. What is machine learning? ``Learning denotes changes in the system that are adaptive in the sense that they enable the system to do the task or tasks drawn from the same population more efficiently and more effectively the next time.'' -- Herbert Simon WORLD Percept Action AGENT

  5. “tufa” “tufa” “tufa” Learning concepts and words Can you pick out the tufas? Source: Josh Tenenbaum

  6. Why “Learn” ? Learning is used when: • Human expertise is absent (navigating on Mars) • Humans are unable to explain their expertise (speech recognition, vision, language) • Solution changes in time (routing on a computer network) • Solution needs to be adapted to particular cases (user biometrics) • The problem size is to vast for our limited reasoning capabilities (calculating webpage ranks)

  7. Introduction to machine learning • What is machine learning? • How is machine learning related to other fields? • Machine learning applications • Types of learning • Supervised learning • regression • classification • Unsupervised learning • clustering • data association • abnormality detection • dimensionality reduction • structure learning • Semi-supervised learning • Active learning • Reinforcement learning and control of partially observed Markov decision processes.

  8. How is machine learning related to other fields? Electricalengineering Statistics CS ML Philosophy Psychology Neuroscience

  9. Introduction to machine learning • What is machine learning? • How is machine learning related to other fields? • Machine learning applications • Types of learning • Supervised learning • regression • classification • Unsupervised learning • clustering • data association • abnormality detection • dimensionality reduction • structure learning • Semi-supervised learning • Active learning • Reinforcement learning and control of partially observed Markov decision processes.

  10. Chess • In 1996 and 1997, Gary Kasparov, the world chess grandmaster played two tournaments against Deep Blue, a program written by researchers at IBM Source: IBM Research

  11. Deep Blue’s Results in the first tournament: won 1 game, lost 3 and tied 1 • first time a reigning world champion lost to a computer • although Kasparov didn’t see it that way… Source: CNN

  12. Deep Blue’s Results in the second tournament: • second tournament: won 3 games, lost 2, tied 1

  13. Learning is essential to building autonomous robots Source: RoboCup web site

  14. Autonomous robots and self-diagnosis Unknown internal discrete state M1 M2 M3 Unknown continuous signals X1 X2 X3 Y1 Y3 Y2 Sensor readings

  15. Simultaneous localization and map learning

  16. Tracking and activity recognition

  17. Animation and control Source: Aaron Hertzmann

  18. Learning agents that play poker • In full 10-player games Poki is better than a typical low-limit casino player and wins consistently; however, not as good as most experts • New programs being developed for the 2-player game are quite a bit better, and we believe they will very soon surpass all human players Source: The University of Alberta GAMES Group

  19. Speech recognition a Final beliefs Likelihood of data Language model eg Markov model eg mixture of Gaussians P(words | sound) P(sound | words) P(words) Hidden Markov Model (HMM) “Recognize speech” “Wreck a nice beach”

  20. Natural language understanding a • P(meaning | words) P(words | meaning) P(meaning) • We do not yet know good ways to represent "meaning" (knowledge representation problem) • Most current approaches involve "shallow parsing", where the meaning of a sentence can be represented by fields in a database, eg • "Microsoft acquired AOL for $1M yesterday" • "Yahoo failed to avoid a hostile takeover from Google"

  21. Example: Handwritten digit recognition for postal codes

  22. Example: Face Recognition Training examples of a person Test images AT&T Laboratories, Cambridge UK http://www.uk.research.att.com/facedatabase.html

  23. Interactive robots

  24. Introduction to machine learning • What is machine learning? • How is machine learning related to other fields? • Machine learning applications • Types of learning • Supervised learning • classification • regression • Unsupervised learning • clustering • data association • abnormality detection • dimensionality reduction • structure learning • Semi-supervised learning • Active learning • Reinforcement learning and control of partially observed Markov decision processes.

  25. Example: Credit scoring Differentiating between low-risk and high-risk customers from their income and savings Classification Discriminant: IF income > θ1 AND savings > θ2 THEN low-risk ELSE high-risk Input data is two dimensional, output is binary {0,1}

  26. Classification of DNA arrays   Not cancer Cancer/ not cancer Y1 YN Y* X1 XN X* DNA array Cancer

  27. Classification p features (attributes) Training set: X: n by py: n by 1 n cases Test set

  28. Hypothesis (decision tree) yes blue? oval? yes no big? no no yes

  29. Decision Tree blue? oval? yes big? no ? no yes

  30. Decision Tree blue? oval? yes big? no ? no yes

  31. What's the right hypothesis?

  32. What's the right hypothesis?

  33. How about now?

  34. How about now?

  35. Noisy/ mislabeled data

  36. Overfitting • Memorizes irrelevant details of training set

  37. Underfitting • Ignores essential details of training set

  38. Now we’re given a larger data set

  39. Now more complex hypothesis is ok

  40. Linear regression • Example: Price of a used car • x : car attributes y : price y = g (x,θ) g ( ) model,  = (w,w0) parameters (slope and intercept) y = wx+w0 Regression is like classification except the output is a real-valued scalar

  41. Nonlinear regression • Useful for: • Prediction • Control • Compression • Outlier detection • Knowledge extraction

  42. Introduction to machine learning • What is machine learning? • How is machine learning related to other fields? • Machine learning applications • Types of learning • Supervised learning • classification • regression • Unsupervised learning • clustering • data association • abnormality detection • dimensionality reduction • structure learning • Semi-supervised learning • Active learning • Reinforcement learning and control of partially observed Markov decision processes.

  43. Clustering Desired output Input Hard labeling Soft labeling K=3 is the number of clusters, here chosen by hand

  44. Clustering group ’s Y1 Y2 YN “angel fish” “kitty” “yellow fish”

  45. Introduction to machine learning • What is machine learning? • How is machine learning related to other fields? • Machine learning applications • Types of learning • Supervised learning • classification • regression • Unsupervised learning • clustering • data association • abnormality detection • dimensionality reduction • structure learning • Semi-supervised learning • Active learning • Reinforcement learning and control of partially observed Markov decision processes.

  46. Semi-supervised learning

  47. Introduction to machine learning • What is machine learning? • How is machine learning related to other fields? • Machine learning applications • Types of learning • Supervised learning • classification • regression • Unsupervised learning • clustering • data association • abnormality detection • dimensionality reduction • structure learning • Semi-supervised learning • Active learning • Reinforcement learning and control of partially observed Markov decision processes.

  48. Does reading this improve your knowledge of Gaussians? Active learning • Active learning is a principled way of integrating decision theory with traditional statistical methods for learning models from data. • In active learning, the machine can query the environment. That is, it can ask questions. • Decision theory leads to optimal strategies for choosing when and what questions to ask in order to gather the best possible data. Good data is often better than a lot of data.

  49. Nonlinear regression • Useful for predicting: • House prices • Drug dosages • Chemical processes • Spatial variables • Output of control action

  50. Active learning example

More Related