150 likes | 370 Views
Machine Learning. 张万才. 硅谷最看重的 12 项 IT 技能之首:机器学习 一种学习型算法. Outline. Linear regression Multivariance Linear Regression Logistic regression Linear Regression with regularization Regularized Logistic Regression. Authors :. 网易公开课 Andrew Ng :吴恩达 (http://cs.stanford.edu/people/ang/)
E N D
Machine Learning 张万才
硅谷最看重的12项IT技能之首:机器学习 • 一种学习型算法
Outline • Linear regression • Multivariance Linear Regression • Logistic regression • Linear Regression with regularization • Regularized Logistic Regression
Authors: • 网易公开课 • Andrew Ng:吴恩达 (http://cs.stanford.edu/people/ang/) • 恩师:Michael I. Jordan • Latent dirichlet allocation:DM Blei, AY Ng, MI Jordan
linear regression • Cost Function • matlab函数介绍 • Legend • hold on, hold off • Linspace • logspace
linear regression • Gradient descent • Gradient descent algorithm
Multivariance Linear Regression • Gradient Descent: • Algorithm • Learning Rate • Polynomial Regression • Normal Equation
logistic regression • logistic function-sigmoid function • loss function • Gradient descentAlgorithm
logistic regression • Other optimization algorithms • Newton’s method
Multi-class Classification • one-vs-all
Linear Regression with regularization • Example • Addressing overfitting
Linear Regression with regularization • Regularization • Gradient descent update rules
Regularized Logistic Regression • Example • Regularized Logistic Regression: • Loss function and update rules Look identical to regulized linear regression