2022-Spring-CSE151A-Introduction to Machine Learning

Undergraduate Class, CSE, UCSD, 2022

Class Time: Tuesdays and Thursdays, 9:30AM to 10:50AM. Room: WLH 2005. Piazza: piazza.com/ucsd/spring2022/cse151a.

Additonal Course Policy for COVID-19

While the university does not close, we are still in a pandemic. Here are some additional policies specifically designed to better protect our students in this course from COVID-19 risks.

  • First-week lectures online. We will deliver the first-week lectures online, as the students on the super-long waitlist may want to attend the first lecture too and we will likely flood the physical classroom.
  • Attendance is optional. Podcast is enabled. You can also check out my previous offering, which has Zoom videos.
  • Midterm is take-home instead of in-class.

Overview

This course mainly focuses on introducing machine learning methods and models that are useful in analyzing real-world data. It will cover classical regression & classification models, clustering methods, and deep neural networks. No previous background in machine learning is required, but all participants should be comfortable with programming, and with basic optimization and linear algebra.

There is no textbook required, but here are some recommended readings:

Prerequisites

  1. Ability to code in Python: functions, control structures, string handling, arrays and dictionaries.

  2. Familiarity with basic probability, at the level of CSE 21 or CSE 103.

  3. Familiarity with basic linear algebra, at the level of Math 18 or Math 20F.

TAs and Tutors

  • Teaching Assistants:
    • Chengyu Dong (cdong AT ucsd.edu)
    • Weitang Liu (wel022 AT ucsd.edu)
    • Rajeshwari Sah (rasah AT ucsd.edu)
    • Zilong Wang (ziw049 AT ucsd.edu)

Office Hours

Note: all times are in Pacific Time.

Grading

  • Homework: 15% each. Your lowest (of five) homework grades is dropped (or one homework can be skipped).
  • Midterm: 40%.
  • You should complete all work individually.
  • Late submissions are NOT accepted.

Lecture Schedule

Recording Note: Please download the recording video for the full length. Dropbox website will only show you the first one hour.

HW Note: All HWs due before the lecture time 9:30 AM PT in the morning.

(the schedule is tentative)

WeekDateTopic & SlidesEvents
103/29 (Tue)Introduction: Concepts and EvaluationsHW1 out
103/31 (Thu)A Geometric View of Linear Algebra 
204/05 (Tue)Nearest Neighbor ClassificationHW1 due, HW2 out
204/07 (Thu)Gradients and Optimization 
304/12 (Tue)Least-Squares Regression, Logistic Regression, and Perceptron 
304/14 (Thu)Overfitting and Regularization 
404/19 (Tue)Support Vector Machine (SVM) 
404/21 (Thu)SVM: Duality and KernelHW2 due, HW3 out
504/26 (Tue)K-Means Clustering & its Variants 
504/28 (Thu)“Soft” Clustering: Gaussian Mixture 
605/03 (Tue)Principle Component Analysis 
605/05 (Thu)Midterm (no class, take-home, 24-hour) 
705/10 (Tue)Naive Bayes and Decision TreeHW4 out
705/12 (Thu)Ensemble Learning: Bagging and BoostingHW3 due
805/17 (Tue)Multi-class Classification 
805/19 (Thu)Feed-forward Neural Networks 
905/24 (Tue)Convolutional Neural NetworksHW4 due, HW5 out
905/26 (Thu)Semi-supervised Learning 
1005/31 (Tue)Weakly-supervised Learning 
1006/02 (Thu)Bias-Variance in Deep Neural NetworksHW5 due

Homework (60%)

Your lowest (of five) homework grades is dropped (or one homework can be skipped).

  • HW1: Concepts and Evaluations (15%). This homework mainly focuses on the machine learning concepts and how to evaluate different tasks.
  • HW2: KNN and Linear Models (15%). This homework mainly focuses on nearest neighbor, least-square regression, logistic regression, and regularization.
  • HW3: SVM and Clustering (15%). This homework mainly focuses on support vector machine, k-means, Gaussian Mixture, and PCA.
  • HW4: Ensemble Learning (15%). This homework mainly focuses on decision tree, random forest, and AdaBoost.
  • HW5: Neural Networks (15%). This homework mainly focuses on implementation of some simple neural networks.

Midterm (40%)

It is an open-book, take-home exam, which covers all lectures given before the Midterm. Most of the questions will be open-ended. Some of them might be slightly more difficult than homework. You will have 24 hours to complete the midterm, which is expected for about 2 hours.

  • Start: May 5, 9:30 AM PT
  • End: May 6, 9:30 AM PT
  • Midterm problems download: here
  • Please make your submissions on Gradescope.