510 likes | 615 Views
Discriminative, Unsupervised, Convex Learning. Dale Schuurmans Department of Computing Science University of Alberta MITACS Workshop, August 26, 2005. Current Research Group. PhD Tao Wang reinforcement learning PhD Ali Ghodsi dimensionality reduction
E N D
Discriminative, Unsupervised, Convex Learning Dale Schuurmans Department of Computing Science University of Alberta MITACS Workshop, August 26, 2005
Current Research Group PhD Tao Wang reinforcement learning PhD Ali Ghodsi dimensionality reduction PhD Dana Wilkinson action-based embedding PhD Yuhong Guo ensemble learning PhD Feng Jiao bioinformatics PhD Jiayuan Huang transduction on graphs PhD Qin Wang statistical natural language PhD Adam Milstein robotics, particle filtering PhD Dan Lizotte optimization, everything PhD Linli Xu unsupervised SVMs PDF Li Cheng computer vision
Current Research Group PhD Tao Wang reinforcement learning PhD Dana Wilkinson action-based embedding PhD Feng Jiao bioinformatics PhD Qin Wang statistical natural language PhD Dan Lizotte optimization, everything PDF Li Cheng computer vision
Today I will talk about: One Current Research Direction Learning Sequence Classifiers (HMMs) • Discriminative • Unsupervised • Convex EM?
Outline • Unsupervised SVMs • Discriminative, unsupervised, convex HMMs • Tao, Dana, Feng, Qin, Dan, Li
Unsupervised Support Vector Machines Joint work with Linli Xu
Main Idea • UnsupervisedSVMs (and semi-supervised SVMs) • Harder computational problem than SVMs • Convex relaxation – Semidefinite program (Polynomial time)
Background: Two-class SVM • Supervised classification learning • Labeled data linear discriminant • Classification rule: + Some better than others?
Maximum Margin Linear Discriminant Choose a linear discriminant to maximize
Unsupervised Learning • Given unlabeled data, how to infer classifications? • Organize objects into groups — clustering
Idea: Maximum Margin Clustering • Given unlabeled data, find maximum margin separating hyperplane • Clusters the data • Constraint:class balance: bound difference in sizes between classes
Challenge • Find label assignment that results in a large margin • Hard • Convex relaxation – based on semidefinite programming
How to Derive Unsupervised SVM? Two-class case: • Start with Supervised Algorithm Given vector of assignments, y, solve Inv. sq. margin
How to Derive Unsupervised SVM? • Think of as a function of y Goal: Choose y to minimize inverse squared margin If given y, would then solve Problem: not a convex function of y Inv. sq. margin
How to Derive Unsupervised SVM? • Re-express problem with indicators comparing y labels New variables: An equivalence relation matrix If given y, would then solve Inv. sq. margin
How to Derive Unsupervised SVM? • Re-express problem with indicators comparing y labels New variables: An equivalence relation matrix If given M, would then solve Note:convex function of M Inv. sq. margin Maximum of linear functions is convex
How to Derive Unsupervised SVM? • Get constrained optimization problem Solve for M encodes an equivalence relation iff Not convex! Class balance
How to Derive Unsupervised SVM? • Get constrained optimization problem Solve for M encodes an equivalence relation iff
How to Derive Unsupervised SVM? • Relax indicator variables to obtain a convex optimization problem Solve for M
How to Derive Unsupervised SVM? • Relax indicator variables to obtain a convex optimization problem Solve for M Semidefinite program
Multi-class Unsupervised SVM? • Start with Supervised Algorithm Given vector of assignments, y, solve Margin loss (Crammer & Singer 01)
Multi-class Unsupervised SVM? • Think of as a function of y Goal: Choose y to minimize margin loss If given y, would then solve Margin loss Problem: not a convex function of y (Crammer & Singer 01)
Multi-class Unsupervised SVM? • Re-express problem with indicators comparing y labels New variables: M & D If given y, would then solve Margin loss (Crammer & Singer 01)
Multi-class Unsupervised SVM? • Re-express problem with indicators comparing y labels New variables: M & D If given MandD, would then solve Margin loss convex function of M & D
Multi-class Unsupervised SVM? • Get constrained optimization problem Solve for MandD Class balance
Multi-class Unsupervised SVM? • Relax indicator variables to obtain a convex optimization problem Solve for MandD
Multi-class Unsupervised SVM? • Relax indicator variables to obtain a convex optimization problem Solve for MandD Semidefinite program
Experimental Results SemiDef Spectral Clustering Kmeans
Experimental Results Percentage of misclassification errors Digit dataset
Extension to Semi-Supervised Algorithm MatrixM :
Experimental Results Percentage of misclassification errors Face dataset
Discriminative, Unsupervised, Convex HMMs Joint work with Linli Xu With help from Li Cheng and Tao Wang
Must coordinate local classifiers Hidden Markov Model • Joint probability model • Viterbi classifier “hidden” state observations
HMM Training: Supervised • Given Models input distribution Maximum likelihood Conditional likelihood Discriminative (CRFs)
Marginal likelihood HMM Training: Unsupervised • Given only • Now what? EM! Exactly the part we don’t care about
HMM Training: Unsupervised • Given only The problem with EM: • Not convex • Wrong objective • Too popular • Doesn’t work
HMM Training: Unsupervised • Given only The dream: • Convex training • Discriminative training When will someone invent unsupervised CRFs?
HMM Training: Unsupervised • Given only The question: • How to learn effectively without seeing any y’s?
HMM Training: Unsupervised • Given only The question: • How to learn effectively without seeing any y’s? The answer: • That’s what we already did! Unsupervised SVMs
HMM Training: Unsupervised • Given only The plan: single sequence SVM M3N supervised unsupervised unsup SVM ?
M3N: Max Margin Markov Nets • Relational SVMs • Supervised training: • Given • Solve factored QP
Unsupervised M3Ns • Strategy • Start with supervised M3N QP • y-labels re-express in local M,D equivalence relations • Impose class-balance • Relax non-convex constraints • Then solve a really big SDP • But still polynomial size
Unsupervised M3Ns • SDP
Some Initial Results • Synthetic HMM • Protein Secondary Structure pred.
Current Research Group PhD Tao Wang reinforcement learning PhD Dana Wilkinson action-based embedding PhD Feng Jiao bioinformatics PhD Qin Wang statistical natural language PhD Dan Lizotte optimization, everything PDF Li Cheng computer vision