CSE 5523: Machine Learning and Statistical Pattern Recognition

Introduction to basic concepts of machine learning and statistical pattern recognition; techniques for classification, clustering and data representation and their theoretical analysis.

Details
Textbooks:
Grading

Grading will be based on:

Participation (10%)

You will receive credit for asking and answering thoughtful questions related to the homework on Piazza and engaging in class discussion.

Homeworks (50%)

The homeworks will include both written and programming assignments. Homework should be submitted to the Dropbox folder in Carmen by 11:59pm on the day it is due (unless otherwise instructed). Each student will have 3 flexible days to turn in late homework throughout the semester. As an example, you could turn in the first homework 2 days late and the second homework 1 day late without any penalty. After that you will loose 20% for each day the homework is late. Please email your homework to the instructor in case there are any technical issues with submission.

Midterm (20%)

There will be an in-class midterm on Ocbober 30.

Final Projects (20%)

The final project is an open-ended assignment, with the goal of gaining experience applying the techniques presented in class to real-world datasets. Students should work in groups of 3-4. It is a good idea to discuss your planned project with the instructor to get feedback. The final project report should be 4 pages and is due on December 10. The report should describe the problem you are solving, what data is being used, the proposed technique you are applying, how you plan to evaluate your solution in addition to what baseline is used to compare against.

Resources
  • Piazza (discussion, announcements and restricted resources). https://piazza.com/class/jl02j1py12v28l?cid=1
  • Carmen (homework submission + grades). https://osu.instructure.com/courses/46947
  • Academic Integrity
    Any assignment or exam that you hand in must be your own work (with the exception of group projects). However, talking with others to better understand the material is strongly encouraged. Copying a solution or letting someone copy your solution is cheating. Everything you hand in must be your own words. Code you hand in must be written by you, with the exception of any code provided as part of the assignment. Any collaboration during an exam is considered cheating. Any student who is caught cheating will be reported to the Committee on Academic Misconduct. Please don't take a chance - if you are having trouble understanding the material, let us know and we will be happy to help.
    Homeworks
  • Homework 1 (Due 8/30, hand in a paper copy at the beginning of class)
  • Homework 2 (Due 9/11 submit to Carmen by 11:59pm)
  • Homework 3 (Due 9/27 hand in a papaer copy at the beginning of class)
  • Homework 4 (Due 11/8, turn in to the dropbox on Carmen)
  • Homework 5 (Due 12/5, turn in to the dropbox on Carmen)
  • Anonymous Feedback
    Tentative Schedule:
    Reading Assignments
    Date Topic Required Reading Suggested Reading
    8/21 Course Overview Murphy Chapter 1 Probability Primer (2.1-2.5, 3.1-3.3), Linear Algebra, Calculus
    8/23 Decision Trees CIML Chapter 1 Murphy 16.2
    8/30 Guest Lecture (Wei Xu) Extracting Lexically Divergent Paraphrases from Twitter
    9/4 Statistical Estimation Murphy Chapter 3.1-3.4
    9/6 Statistical Estimation (cont) Murphy Chapter 3.4-3.5 CIML Chapter 9
    9/11 Dirichlet-Multinomial + Naive Bayes Murphy Chapter 3.4-3.5 CIML Chapter 9
    9/13 Linear Regression Murphy Chapter 7.1-7.3, 7.5 7.4, 7.6
    9/18 Logistic Regression Murphy 8.1,8.2,8.31,8.32 Tom Mitchell's Notes on NB + LR
    9/18 @ 4pm Guest Lecture by Eunsol Choi (University of Washington) QuAC Paper
    9/19 @ 4:30pm Guest Lecture by Mark Yatskar (Allen Institute for Artificial Intelligence) Gender Bias Amplification Paper
    9/20 Logistic Regression Murphy 8.3.7, 8.5, 8.6.1 Ng & Jordan 2002
    9/24 Perceptron CIML Chapter 4
    9/26 Instance-Based Learning CIML Chapter 3
    10/2 Kernel Methods CIML 11.1, 11.4
    10/4 SVMs CIML Chapter 7 Murphy 14.1, 14.2, 14.3, 14.4, 14.5
    10/15 Course Project + Boosting (cont) CIML Chapter 13 Murphy 16.4
    Boosting Murphy 16.4
    Neural Networks Murphy 16.5 CIML Chapter 10, Deep Learning Book Chapter 6
    10/25 Midterm Review
    11/13 Expectation Maximization / Unsupervised Learning Murphy Chapter 11 CIML Chapter 16
    11/19 Convolutional Neural Networks Deep Learning Book Chapter 9
    11/28 Recurrent Neural Networks Deep Learning Book Chapter 10
    12/4 Generative Models