Summer 2019 Berlin
 Lectures: Mondays, Wednesdays and Thursdays, 13:00  14:30
Lecture Schedule
Topics link to slides, where available. Topics noted with (Recitation) are covered in recitation that week, not in lecture. You’re responsible for everything listed on this schedule, some of which may not be covered in lecture or recitation.
 LfD means Learning from Data
 AIML means An Introduction to Machine Learning
 I2ML means Introduction to Machine Learning
 RL means Reinforcement Learning: An Introduction
 ISL means An Introduction to Statistical Learning
 PRML means Pattern Recognition and Machine Learning
 ESL means The Elemets of Statistical Learning
 NND means Neural Network Design
 MML means Mathematics for Machine Learning
 VMLS means Introduction to Applied Linear Algebra – Vectors, Matrices and Least Squares
 PSCS means Probability and Statistics for Computer Science
Date  Topics  Reading and Resources  Reminders 

Week 1  
20190513  Orientation  
20190515  Intro to CS4641 
Getting Started Programming in Scala, Ch 1, 2 

20190516  Intro to Machine Learning 
Primary reading: LfD, Ch 1.1, 1.2 Supplemental reading: ISL, Ch 1, 2.1 Deeper reading: PRML 1 

Week 2  
20190520  Scipy 
Numpy Pandas Matplotlib 

20190522  Perceptron Learning Algorithm 
Primary reading: LfD, 1.1.2 Supplemental reading: Math background: VMLS, 1, 2 
HW0 Spark Released HW0 Scipy Released 
20190523 
Error learnability 
Primary reading: LfD 1.4, ISL 2.2 Supplemental reading: Deeper reading: Math background: 

Week 3  
20190527  Error 
Primary reading: LfD 1.4, ISL 2.2 Supplemental reading: Deeper reading: Math background: 
HW0 Due 20190528 
20190529  Spark  
20190530  Himmelfahrt  No Class  
Week 4  
20190603  Linear Classification 
Primary reading: LfD 3.1 Supplemental reading: Deeper reading: Math background: 
HW 1 Released 
20190605  Linear Regression 
Primary reading: LfD 3.2 Supplemental reading: Deeper reading: Math background: 

20190606  Logistic Regression 
Primary reading: LfD 3.3 Supplemental reading: Deeper reading: Math background: Magdon Logistic regression slides 

Week 5  
20190610  Pfingsten  No Class  Project 1 Released  
20190612  Nonlinear Transformation 
Primary reading: LfD 3.4 Supplemental reading: Deeper reading: Math background: Magdon Nonlinear Transformation slides 
HW 1 Due HW2 Released 
20190613  Computational Learning Theory 
Primary reading: LfD 1.3, 1.4.2, 2 Supplemental reading: Deeper reading: Math background: 

Week 6  
20190617  Computational Learning Theory 
Primary reading: LfD 1.3, 1.4.2, 2 Supplemental reading: Deeper reading: Math background: 
HW4 Released 
20190619  Machine Learning Practice 
Primary reading: LfD 4.1, 4.2 Supplemental reading: Deeper reading: Math background: Magdon Overfitting slides Magdon Regularization slides Magdon Validation slides Magdon Learning Principles slides 
HW2 Due 
20190620  Machine Learning Practice 
Primary reading: LfD 4.1, 4.2 Supplemental reading: Deeper reading: Math background: Magdon Overfitting slides Magdon Regularization slides Magdon Validation slides Magdon Learning Principles slides 
HW3 Released 
Week 7  
20190624  Machine Learning Practice 
Primary reading: LfD 4.1, 4.2 Supplemental reading: Deeper reading: Math background: Magdon Overfitting slides Magdon Regularization slides Magdon Validation slides Magdon Learning Principles slides 
Project 1 Due 20190625 
20190626  Review 1 
Primary reading: Supplemental reading: Deeper reading: Math background: Magdon Review1 slides 

20190627  Exam 1 
Primary reading: Supplemental reading: Deeper reading: Math background: 
Answers 
Week 8  
20190701 
Decision Trees Ensemble Methods 
Primary reading: AIML 6 Supplemental reading: I2ML 9 Deeper reading: Math background: Byron Boots Decision Trees slides Primary reading: AIML 9.19.3 Supplemental reading: I2ML 17 Deeper reading: Math background: Alpaydin Combining Learners slides 
Project 2 Released 
20190703 
KNearest Neighbors Radial Basis Functions (kMeans Clustering) 
Primary reading: LfD 6.1  6.2 Supplemental reading: Deeper reading: Math background: Magdon Nearest Neighbor slides Magdon Nearest Neighbor efficiency slides Primary reading: LfD 6.3 Supplemental reading: Deeper reading: Math background: Magdon Radial Basis Function slides 
HW4 Released (HW4 answers) 
20190704  InClass Exercise  HW5 Released (HW5 answers)  
Week 9  
20190708  Probability Density Estimation (kMeans, GMM, EM) 
Primary reading: Supplemental reading: Deeper reading: Math background: Magdon Unsupervised Learning slides 
Project 3 Released 
20190710 
Input Processing Support Vector Machines 
Primary reading: LfD 9.2 Supplemental reading: Deeper reading: Math background: Magdon Learning Aides slides Primary reading: LfD 8 Supplemental reading: Deeper reading: Math background: Magdon SVM: Maximizing Margin slides Magdon Optimal Hyperplane Overfitting slides Magdon Kernel Trick slides Magdon Kernel Machines slides 
HW6 Released (HW6 answers) 
20190711  Neural Networks 
Primary reading: 7.17.5 Supplemental reading: Deeper reading: Math background: Magdon Multilayer Perceptron slides Magdon Backpropagation slides Magdon Neural Network Overfitting slides 
Project 2 Due 
Week 10  
20190715 
Markov Decision Processes Q Learning 
Primary reading: RL 14 Supplemental reading: Deeper reading: Math background: Byron Boots MDP1 slides Byron Boots MDP2 slides Primary reading: RL 5 Supplemental reading: Deeper reading: Math background: Byron Boots RL1 slides Byron Boots RL1 slides 
HW7 Released (HW7 answers) 
Final Exam  
20190720  11:00  13:50 