Recent Changes - Search:




Lectures: Wu & Chen Auditorium, Monday and Wednesday, 10:30am-noon, Friday, 9:30am-11:00am
See canvas for lecture recordings.

Lectures will change; Midterm and final date will not

On your ownlearn linear algebra, basic probabilitySelf Test, Self Test Solutions, Strang’s Course Probability Review Bishop 1.1-1.4, slides
W/Aug 30Intro, intro_slides 
F/Sep 1Intro to Matlab TutorialCoursera octave tutorial
M/Sep 4 No class: Labor Day  
W/Sep 6Local learning Norm slidesBishop 2.5
F/Sep 8Decision Trees (and information theory) slidesDecision Trees by N. Nilsson, Bishop 1.6 Bishop 14.4 KL and mutual info
M/Sep 11Basic Point Estimation (MLE and MAP) PDF slidesBishop 2.1, Appendix B, MLMath covariance
backgroundGaussiansBishop 1.2.4, Bishop 2.3.1-2.3.3
W/Sep 13Regression, Regression slidesBishop 1.1-1.4, Bishop 3.1, 3.1.1, 3.1.4, 3.1.5, 3.2, 3.3, 3.3.1, 3.3.2
F/Sep 15Classification Logistic Regression, Naive Bayes slides
Bishop 4.0, 4.2- 4.5
M/Sep 18NB vs. LR, Basis Functions, RBFsNaive Bayes vs Logistic Regression, short video: RBFs
W/Sep 20Overfitting and Regularization, Bias Variance Decomposition, Bias/Variance for RegressionBishop 1.3, 1.5, 3.2 applet
F/Sep 22regression penalty slides Stepwise, streamwise, stagewiseshort video:stepwise regression,Hastie et al. 7.1-7.3 LASSO (supplemental reading)
M/Sep 25MDL slides, MDL feature selection reviewMDL-supplemental MDL-background
W/Sep 27Neural Net slides Supervised Deep Networkssupplemental: deep net tutorial
F/Sep 29more deep learning Supervised Deep Networkssupplemental: gay learning
M/Oct 2Constrained Optimization and Lagrangian Duality 
W/Oct 4Support Vector Machines
Additional notes, Bishop 7.1 (Max Margin), Hearst 1998
F/Oct 6 No class: Fall Break  
M/Oct 9Kernel Methods
Additional notes, Bishop 6.1,6.2 (Kernels) Supplemental: more on kernels
W/Oct 11Online Learning and Perceptron 
F/Oct 13BoostingAdditional notes, Bishop 14.3, Schapire’s Tutorial
M/Oct 16Performance Measures 
T/Oct 17review session 5:00 p.m. ANNS Room: 110Recitation Remix MLE/MAP examples (Multivariate Gaussian, Poisson) Decision Trees, Cross-Validation, Boosting Complexity consistency
W/Oct 18 Midterm recitation recordingsample exam questions and answers more examples are part of the old final exam below
F/Oct 20 No class  
M/Oct 23Learning Theory? 
W/Oct 25Vectors, Matrices, EigenvectorsKosecka’s review slides
F/Oct 27Dim. Reduction PCA eigenwordsBishop Appendix C Properties of Matrices
extrasPCR, PLS and CCA slides more coursesBishop 12.1 supplemental slides
M/Oct 30Unsupervised Deep Networks
W/Nov 1Unsupervised Learning: Clustering, K-means EMBishop 9.1-9.3
F/Nov 3EM Generative PCABishop 12.1–12.3, supplemental:Neal and Hinton
extrasLDA slidessupplemental:LDA intro and original LDA paper
not coveredGenerative model summary, loss functions and ML speed slides 
M/Nov 6Netflixsupplemental:netflix
W/Nov 8Project overview and advice and project slides; Real world machine learningMore advice and python for converting text to ints
F/Nov 10Bayesian Networkssupplemental: Koller+al, Graphical Models in a Nutshell
M/Nov 13Markov Networkssupplemental: Koller+al, Graphical Models in a Nutshell
W/Nov 15Exact Inference: Junction Tree Algorithmsupplemental: Koller+al, Graphical Models in a Nutshell
F/Nov 17Hidden Markov ModelsRabiner’s HMM Tutorial, supplemental:Bishop 13.1–2
M/Nov 20Structured Prediction? 
W/Nov 22 No class  
F/Nov 24 No class — Happy Thanksgiving!!  
M/Nov 27Semi-Supervised Learning, Active Learning? 
W/Nov 29TBD 
F/Dec 1TBD 
M/Dec 4Reinforcement Learning? 
W/Dec 6Big DataUnreasonable effectiveness of data
F/Dec 8The Future of ML and humanity 
M/Dec 11Final project awards; Final Review Other material Review Questions
LIONbook - a quick review; After CIS520
W/Dec 13 Review Session: 4:00–5:00 pm Building: TBD 
T/Dec 19 Final: 9:00am-11:00am Location TBD 2014 final and solution

Python code to download all course materials: scrape code

Edit - History - Print - Recent Changes - Search
Page last modified on 17 October 2017 at 08:12 PM