Skip to content

Repository for CS282R: Robust Machine Learning at Harvard University.

Notifications You must be signed in to change notification settings

kojino/Harvard-Robust-Machine-Learning

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

56 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

CS282R: Robust Machine Learning Workshop

Coding tutorial for robust machine learning algorithms for CS282R "Robust Machine Learning" taught at Harvard University in Spring 2018.

Overview

This workshop covers the fundamentals of TensorFlow. By the end of this workshop, you will be well equipped to start building your own neural network models in TensorFlow. The workshop will start by introducing concepts unique to TensorFlow, e.g. sessions, variables, optimizers. Later, we'll put these concepts together to build logistic regression, 3-layer NN, and finally, GAN.

The side theme of this workshop is writing clean, structured and well-documented code. ML code tends to get messy. This is especially the case in academic settings where we don't have a manager to review your code. We are also free from the pressure that our code will be used by millions of people. BUT, this never means that you can write sloppy code. The code should be nicely written so that you, three months from now, should be able to come back to the code and tell exactly what each function is doing.

That said, my code is not the best thing in the world. If you find any improvements, or errors in the code, please let me know. Pull requests are always welcome.

Prerequisite

  • Comfortability with Python
  • Understanding of basic deep learning concepts.
  • Fully charged laptop (so tat we don't run out of outlets).
  • Install TensorFlow and other packages by following section 1. Run code in section 3 and make sure things run smoothly before class.

Index

  1. Setup
  2. Introduction
  3. Graphs, Sessions
  4. Basic Operations
  5. Variables, Gradients, Placeholders
  6. Classification, Regression
  7. Visualization
  8. Multi-layer Perceptron
  9. GAN
  10. Adversarial Examples

Appendix: Articles, Papers on robust machine learning

Workshop Format

When learning a new framework, it is better to move hands than to listen. So, we prepared quite a bit of programming exercises. You will work with your project partner on these exercises. Pair programming is extremely effective for being a better coder whether it be software or ML!

  • Introduction to TensorFlow (section 1~6, 30 min)
  • Pair Programming Exercises on Basics (section 1~6, 45 min)
  • Break (10 min)
  • Introduction to Deep Learning with TensorFlow (section 7~9, 30 min)
  • Pair Programming Exercises on Deep Learning (section 7~9, 45 min)

Things we will not cover

Here are the list of things we will not cover but you might want to self-learn:

Reference

How to contribute

We want this repository to be a source of information related to robust machine learning. To do so, we need your help. In particular, you can send a pull request to this repository. For details, see this. Some types of contribution can be:

  • Adding more models from our assigned papers to the tutorial.
  • Adding papers/articles you found interesting to Papers.md, Articles.md.
  • Fixing typos (always a good start if you're new to OSS).

Finally, don't forget to add your name below to give yourself a credit for the work you put in :)

Material created by: Kojin Oshiba, Jerry Anunrojwong.
Course taught by Professor Yaron Singer.

About

Repository for CS282R: Robust Machine Learning at Harvard University.

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published