Summer 2019 Berlin
- Lectures: Mondays, Wednesdays and Thursdays, 13:00 - 14:30
Lecture Schedule
Topics link to slides, where available. Topics noted with (Recitation) are covered in recitation that week, not in lecture. You’re responsible for everything listed on this schedule, some of which may not be covered in lecture or recitation.
- LfD means Learning from Data
- AIML means An Introduction to Machine Learning
- I2ML means Introduction to Machine Learning
- RL means Reinforcement Learning: An Introduction
- ISL means An Introduction to Statistical Learning
- PRML means Pattern Recognition and Machine Learning
- ESL means The Elemets of Statistical Learning
- NND means Neural Network Design
- MML means Mathematics for Machine Learning
- VMLS means Introduction to Applied Linear Algebra – Vectors, Matrices and Least Squares
- PSCS means Probability and Statistics for Computer Science
Date | Topics | Reading and Resources | Reminders |
---|---|---|---|
Week 1 | |||
2019-05-13 | Orientation | ||
2019-05-15 | Intro to CS4641 |
Getting Started Programming in Scala, Ch 1, 2 |
|
2019-05-16 | Intro to Machine Learning |
Primary reading: LfD, Ch 1.1, 1.2 Supplemental reading: ISL, Ch 1, 2.1 Deeper reading: PRML 1 |
|
Week 2 | |||
2019-05-20 | Scipy |
Numpy Pandas Matplotlib |
|
2019-05-22 | Perceptron Learning Algorithm |
Primary reading: LfD, 1.1.2 Supplemental reading: Math background: VMLS, 1, 2 |
HW0 Spark Released HW0 Scipy Released |
2019-05-23 |
Error learnability |
Primary reading: LfD 1.4, ISL 2.2 Supplemental reading: Deeper reading: Math background: |
|
Week 3 | |||
2019-05-27 | Error |
Primary reading: LfD 1.4, ISL 2.2 Supplemental reading: Deeper reading: Math background: |
HW0 Due 2019-05-28 |
2019-05-29 | Spark | ||
2019-05-30 | Himmelfahrt - No Class | ||
Week 4 | |||
2019-06-03 | Linear Classification |
Primary reading: LfD 3.1 Supplemental reading: Deeper reading: Math background: |
HW 1 Released |
2019-06-05 | Linear Regression |
Primary reading: LfD 3.2 Supplemental reading: Deeper reading: Math background: |
|
2019-06-06 | Logistic Regression |
Primary reading: LfD 3.3 Supplemental reading: Deeper reading: Math background: Magdon Logistic regression slides |
|
Week 5 | |||
2019-06-10 | Pfingsten - No Class | Project 1 Released | |
2019-06-12 | Nonlinear Transformation |
Primary reading: LfD 3.4 Supplemental reading: Deeper reading: Math background: Magdon Nonlinear Transformation slides |
HW 1 Due HW2 Released |
2019-06-13 | Computational Learning Theory |
Primary reading: LfD 1.3, 1.4.2, 2 Supplemental reading: Deeper reading: Math background: |
|
Week 6 | |||
2019-06-17 | Computational Learning Theory |
Primary reading: LfD 1.3, 1.4.2, 2 Supplemental reading: Deeper reading: Math background: |
HW4 Released |
2019-06-19 | Machine Learning Practice |
Primary reading: LfD 4.1, 4.2 Supplemental reading: Deeper reading: Math background: Magdon Overfitting slides Magdon Regularization slides Magdon Validation slides Magdon Learning Principles slides |
HW2 Due |
2019-06-20 | Machine Learning Practice |
Primary reading: LfD 4.1, 4.2 Supplemental reading: Deeper reading: Math background: Magdon Overfitting slides Magdon Regularization slides Magdon Validation slides Magdon Learning Principles slides |
HW3 Released |
Week 7 | |||
2019-06-24 | Machine Learning Practice |
Primary reading: LfD 4.1, 4.2 Supplemental reading: Deeper reading: Math background: Magdon Overfitting slides Magdon Regularization slides Magdon Validation slides Magdon Learning Principles slides |
Project 1 Due 2019-06-25 |
2019-06-26 | Review 1 |
Primary reading: Supplemental reading: Deeper reading: Math background: Magdon Review1 slides |
|
2019-06-27 | Exam 1 |
Primary reading: Supplemental reading: Deeper reading: Math background: |
Answers |
Week 8 | |||
2019-07-01 |
Decision Trees Ensemble Methods |
Primary reading: AIML 6 Supplemental reading: I2ML 9 Deeper reading: Math background: Byron Boots Decision Trees slides Primary reading: AIML 9.1-9.3 Supplemental reading: I2ML 17 Deeper reading: Math background: Alpaydin Combining Learners slides |
Project 2 Released |
2019-07-03 |
K-Nearest Neighbors Radial Basis Functions (k-Means Clustering) |
Primary reading: LfD 6.1 - 6.2 Supplemental reading: Deeper reading: Math background: Magdon Nearest Neighbor slides Magdon Nearest Neighbor efficiency slides Primary reading: LfD 6.3 Supplemental reading: Deeper reading: Math background: Magdon Radial Basis Function slides |
HW4 Released (HW4 answers) |
2019-07-04 | In-Class Exercise | HW5 Released (HW5 answers) | |
Week 9 | |||
2019-07-08 | Probability Density Estimation (k-Means, GMM, EM) |
Primary reading: Supplemental reading: Deeper reading: Math background: Magdon Unsupervised Learning slides |
Project 3 Released |
2019-07-10 |
Input Processing Support Vector Machines |
Primary reading: LfD 9.2 Supplemental reading: Deeper reading: Math background: Magdon Learning Aides slides Primary reading: LfD 8 Supplemental reading: Deeper reading: Math background: Magdon SVM: Maximizing Margin slides Magdon Optimal Hyperplane Overfitting slides Magdon Kernel Trick slides Magdon Kernel Machines slides |
HW6 Released (HW6 answers) |
2019-07-11 | Neural Networks |
Primary reading: 7.1-7.5 Supplemental reading: Deeper reading: Math background: Magdon Multilayer Perceptron slides Magdon Backpropagation slides Magdon Neural Network Overfitting slides |
Project 2 Due |
Week 10 | |||
2019-07-15 |
Markov Decision Processes Q Learning |
Primary reading: RL 1-4 Supplemental reading: Deeper reading: Math background: Byron Boots MDP1 slides Byron Boots MDP2 slides Primary reading: RL 5 Supplemental reading: Deeper reading: Math background: Byron Boots RL1 slides Byron Boots RL1 slides |
HW7 Released (HW7 answers) |
Final Exam | |||
2019-07-20 | 11:00 - 13:50 |