CPSC 340: Machine Learning and Data Mining (2021W1)

This is the public-facing portion of the course website; also see the Canvas course for links to the course Piazza site, lecture recordings, and submitting assignments.

Course documents

• syllabus
• homework submission instructions
• textbooks and online resources
• CPSC 340 vs. CPSC 330 vs. CPSC 440

Schedule

Note: In the timetable below, the textbook codes (such as "AI:AMA") are defined here.

Date	Slides	Related Readings and Links	Homework and Notes
Wed Sep 8	Motivation and Syllabus	What is Machine Learning? Machine Learning Rise of the Machines Talking Machine Episode 1	a1 posted
Fri Sep 10	Exploratory Data Analysis	Gotta Catch'em all Why Not to Trust Statistics Visualization Types Google Chart Gallery Other Tools
Mon Sep 13	Decision Trees	A Visual Introduction to Machine Learning, Decision Trees Entropy AI:AMA 18.2-3, ESL: 9.2, ML:APP 16.2	Big-O Notes, Week 1 Tutorials
Wed Sep 15	Fundamentals of Learning	7 Steps of Machine Learning IID Cross-validation Bias-variance No Free Lunch AI: AMA 18.4-5, ESL 7.1-7.4, 7.10, ML:APP 1.4, 6.5	Course Notation Guide
Mon Sep 20	Non-Parametric Models	K-nearest neighbours Decision Theory for Darts Norms AI: AMA 18.8, ESL 13.3, ML:APP 1.4
Wed Sep 22	Ensemble Methods	Ensemble Methods Random Forests Empirical Study Kinect AI: AMA 18.10, ESL: 7.11, 8.2, 15, 16.3, ML: APP 6.2.1, 16.2.5, 16.6
Fri Sep 24	Clustering	Clustering K-means clustering (demo) K-Means++ (demo) IDM 8.1-8.2, ESL: 14.3
Mon Sep 27	More Clustering	DBSCAN (video, demo) Hierarchical Clustering Phylogenetic Trees IDM 8.4
Wed Sep 29	Outlier Detection	Empirical Study IDM 8.3, ESL 14.3.12, ML:APP 25.5
Fri Oct 1	Least Squares	Linear Regression (demo, 2D data, 2D video) Least Squares Essence of Calculus Partial Derivative Gradient ESL 3.1-2, ML:APP 7.1-3, AI:AMA 18.6	Assignment 2 due
Mon Oct 4	Nonlinear Regression	Why should one learn machine learning from scratch? Essence of Linear Algebra Matrix Differentiation Fluid Simulation (video) ESL 5.1, 6.3	Linear Algebra Notes Linear/Quadratic Gradients
Wed Oct 6	Gradient Descent	Gradient Descent Convex Functions
Fri Oct 8	Finding Similar Items (Bonus Lecture)	MMD Chapter 3
Mon Oct 11		THANKSGIVING - NO CLASS
Wed Oct 13	Robust Regression	ML:APP 7.4
Fri Oct 15	Feature Selection	Genome-Wide Association Studies AIC, BIC ESL 3.3 , 7.5-7	Assignment 3 due
Mon Oct 18	Regularization	ESL 3.4., ML:APP 7.5, AI:AMA 18.4
Wed Oct 20	More Regularization	RBF video RBF and Regularization video ESL 6.7, ML:APP 13.3-4
Thu Oct 21		MIDTERM (6:00-7:30pm)
Fri Oct 22	Linear Classifiers	Perceptron ESL 4.5, ML:APP 8.5
Mon Oct 25	More Linear Classifiers	Support Vector Machines ESL 4.4, 12.1-2, ML:APP 8.1-3, 9.5 14.5, AI:AMA 18.9
Wed Oct 27	Feature Engineering	Gmail Priority Inbox
Fri Oct 29	Convolutions
Mon Nov 1	Kernel Trick	ESL 12.3, ML:APP 14.1-4
Wed Nov 3	Stochastic Gradient	Stochastic Gradient ML:APP 8.5
Fri Nov 5	Boosting	AdaBoost (video) XGBoost (video) ML:APP 16.4	Assignment 4 due Max and Argmax Notes
Mon Nov 8	MLE and MAP	Maximum Likelihood Estimation ML:APP 9.3-4
Wed Nov 10	Principal Component Analysis	Principal Component Analysis ESL 14.5, IDM B.1, ML:APP 12.2
Fri Nov 12		MIDTERM BREAK - NO CLASS
Mon Nov 15		MIDTERM BREAK - NO CLASS
Wed Nov 17	More PCA	Making Sense of PCA SVD Eigenfaces
Fri Nov 19	Sparse Matrix Factorization	Non-Negative Matrix Factorization (original - access from UBC) ESL 14.6, ML: APP 13.8
Mon Nov 22	Recommender Systems	Recommender Systems Netflix Prize
Wed Nov 24	Multi-Dimensional Scaling	Nonlinear Dimensionality Reduction t-SNE demo ESL 14.8-9, IDM B.2	Assignment 5 due
Fri Nov 26	Deep Learning	Google Video What is a Neural Network? Interactive Guide ML:APP 16.5, ESL 11.1-4, AI: AMA 18.7
Mon Nov 29	More Deep Learning	Fortune Article Deep Learning References Alchemy ML:APP 28.3, ESL 11.5
Wed Dec 1	Convolutional Neural Networks	Convolutional Neural Networks ML:APP 28.4, ESL 11.7
Fri Dec 3	Bonus lecture	Semi-Supervised Learning Label Propagation at Google AlexNet
Mon Dec 6	Bonus lecture	PageRank Slides PageRank Math/Code, ESL 14.10, AI: AMA 22.3 Non-convex PL Inequality	Assignment 6 due