Summer 2019 Berlin

Lecture Schedule

Topics link to slides, where available. Topics noted with (Recitation) are covered in recitation that week, not in lecture. You’re responsible for everything listed on this schedule, some of which may not be covered in lecture or recitation.

Date Topics Reading and Resources Reminders
Week 1
2019-05-13 Orientation
2019-05-15 Intro to CS4641 Getting Started
Programming in Scala, Ch 1, 2
2019-05-16 Intro to Machine Learning Primary reading: LfD, Ch 1.1, 1.2
Supplemental reading: ISL, Ch 1, 2.1
Deeper reading: PRML 1
Week 2
2019-05-20 Scipy Numpy
Pandas
Matplotlib
2019-05-22 Perceptron Learning Algorithm Primary reading: LfD, 1.1.2
Supplemental reading:
Math background: VMLS, 1, 2
HW0 Spark Released
HW0 Scipy Released
2019-05-23 Error
learnability
Primary reading: LfD 1.4, ISL 2.2
Supplemental reading:
Deeper reading:
Math background:
Week 3
2019-05-27 Error Primary reading: LfD 1.4, ISL 2.2
Supplemental reading:
Deeper reading:
Math background:
HW0 Due 2019-05-28
2019-05-29 Spark
2019-05-30 Himmelfahrt - No Class
Week 4
2019-06-03 Linear Classification Primary reading: LfD 3.1
Supplemental reading:
Deeper reading:
Math background:
HW 1 Released
2019-06-05 Linear Regression Primary reading: LfD 3.2
Supplemental reading:
Deeper reading:
Math background:
2019-06-06 Logistic Regression Primary reading: LfD 3.3
Supplemental reading:
Deeper reading:
Math background:
Magdon Logistic regression slides
Week 5
2019-06-10 Pfingsten - No Class Project 1 Released
2019-06-12 Nonlinear Transformation Primary reading: LfD 3.4
Supplemental reading:
Deeper reading:
Math background:
Magdon Nonlinear Transformation slides
HW 1 Due
HW2 Released
2019-06-13 Computational Learning Theory Primary reading: LfD 1.3, 1.4.2, 2
Supplemental reading:
Deeper reading:
Math background:
Week 6
2019-06-17 Computational Learning Theory Primary reading: LfD 1.3, 1.4.2, 2
Supplemental reading:
Deeper reading:
Math background:
HW4 Released
2019-06-19 Machine Learning Practice Primary reading: LfD 4.1, 4.2
Supplemental reading:
Deeper reading:
Math background:
Magdon Overfitting slides
Magdon Regularization slides
Magdon Validation slides
Magdon Learning Principles slides
HW2 Due
2019-06-20 Machine Learning Practice Primary reading: LfD 4.1, 4.2
Supplemental reading:
Deeper reading:
Math background:
Magdon Overfitting slides
Magdon Regularization slides
Magdon Validation slides
Magdon Learning Principles slides
HW3 Released
Week 7
2019-06-24 Machine Learning Practice Primary reading: LfD 4.1, 4.2
Supplemental reading:
Deeper reading:
Math background:
Magdon Overfitting slides
Magdon Regularization slides
Magdon Validation slides
Magdon Learning Principles slides
Project 1 Due 2019-06-25
2019-06-26 Review 1 Primary reading:
Supplemental reading:
Deeper reading:
Math background:
Magdon Review1 slides
2019-06-27 Exam 1 Primary reading:
Supplemental reading:
Deeper reading:
Math background:
Answers
Week 8
2019-07-01 Decision Trees
Ensemble Methods
Primary reading: AIML 6
Supplemental reading: I2ML 9
Deeper reading:
Math background:
Byron Boots Decision Trees slides
Primary reading: AIML 9.1-9.3
Supplemental reading: I2ML 17
Deeper reading:
Math background:
Alpaydin Combining Learners slides
Project 2 Released
2019-07-03 K-Nearest Neighbors
Radial Basis Functions (k-Means Clustering)
Primary reading: LfD 6.1 - 6.2
Supplemental reading:
Deeper reading:
Math background:
Magdon Nearest Neighbor slides
Magdon Nearest Neighbor efficiency slides
Primary reading: LfD 6.3
Supplemental reading:
Deeper reading:
Math background:
Magdon Radial Basis Function slides
HW4 Released (HW4 answers)
2019-07-04 In-Class Exercise HW5 Released (HW5 answers)
Week 9
2019-07-08 Probability Density Estimation (k-Means, GMM, EM) Primary reading:
Supplemental reading:
Deeper reading:
Math background:
Magdon Unsupervised Learning slides
Project 3 Released
2019-07-10 Input Processing
Support Vector Machines
Primary reading: LfD 9.2
Supplemental reading:
Deeper reading:
Math background:
Magdon Learning Aides slides
Primary reading: LfD 8
Supplemental reading:
Deeper reading:
Math background:
Magdon SVM: Maximizing Margin slides
Magdon Optimal Hyperplane Overfitting slides
Magdon Kernel Trick slides
Magdon Kernel Machines slides
HW6 Released (HW6 answers)
2019-07-11 Neural Networks Primary reading: 7.1-7.5
Supplemental reading:
Deeper reading:
Math background:
Magdon Multilayer Perceptron slides
Magdon Backpropagation slides
Magdon Neural Network Overfitting slides
Project 2 Due
Week 10
2019-07-15 Markov Decision Processes
Q Learning
Primary reading: RL 1-4
Supplemental reading:
Deeper reading:
Math background:
Byron Boots MDP1 slides
Byron Boots MDP2 slides
Primary reading: RL 5
Supplemental reading:
Deeper reading:
Math background:
Byron Boots RL1 slides
Byron Boots RL1 slides
HW7 Released (HW7 answers)
Final Exam
2019-07-20 11:00 - 13:50