schedule.md

layout	default
title	MATH 80600A - Machine Learning II<br>Deep Learning and Applications
permalink	/schedule
schedule	date topics readings Jan.<br>7, 8 name url Introduction https://www.dropbox.com/s/hbrmctcap9ebo60/Week1-Intro.pdf?dl=0 name url Mathematics https://www.dropbox.com/s/o09puw2vf59uxj5/Week1-Maths.pdf?dl=0 name url Machine Learning Basics https://www.dropbox.com/s/5ntgm9t4ykeq1b7/Week1-ML.pdf?dl=0 name Deep Learning Book name url Chap. 2 http://www.deeplearningbook.org/contents/linear_algebra.html name url Chap. 3 http://www.deeplearningbook.org/contents/prob.html name url Chap. 5 http://www.deeplearningbook.org/contents/ml.html date topics readings Jan.<br>14, 15 name url Feedforward Neural Networks & Optimization Tricks https://www.dropbox.com/s/zv4920r75ek7u4u/Week2-FFN%26Regularization.pdf?dl=0 name Deep Learning Book name url Chap. 6 http://www.deeplearningbook.org/contents/mlp.html name url Chap. 7 http://www.deeplearningbook.org/contents/regularization.html name url Chap. 8 http://www.deeplearningbook.org/contents/optimization.html date topics readings homeworks Jan.<br>21, 22 name url PyTorch part 1 https://www.dropbox.com/s/xpd4fjisk3n08vx/Deep%20Learning%20Frameworks%20part%201.pdf?dl=0 name url PyTorch Part 2 https://www.dropbox.com/s/2mzbdnfgah9yimw/Deep%20Learning%20Frameworks%20part%202.pdf?dl=0 name url Python Numpy Tutorial http://cs231n.github.io/python-numpy-tutorial/ name url Neural Network from Scratch https://medium.com/dair-ai/a-simple-neural-network-from-scratch-with-pytorch-and-google-colab-c7f3830618e0 name url Dive into Deep Learning https://github.com/dsgiitr/d2l-pytorch name url Instruction https://www.dropbox.com/s/7s19xya7yck4nul/HWK1.pdf?dl=0 name url Colab https://colab.research.google.com/drive/1FjRjNlBqPVz7SrEPvqrL10Q76NeHhvJW?usp=sharing date topics readings presentations Jan.<br>28, 29 name url Convolutional Neural Networks & Recurrent Neural Networks https://www.dropbox.com/s/9vnrcjo4ykhdj9l/Week4-CNN%26RNN.pdf?dl=0 name Deep Learning Book name url Chap. 9 http://www.deeplearningbook.org/contents/convnets.html name url Chap. 10 http://www.deeplearningbook.org/contents/rnn.html name url ResNet http://arxiv.org/abs/1512.03385 name url GRU https://arxiv.org/abs/1412.3555 name url DenseNet https://arxiv.org/abs/1608.06993 date topics readings presentations Feb.<br>4, 5 name url Natural Language Processing I https://www.dropbox.com/s/bjxvre1d3w30iqj/Week5-DL4NLP-part1.pdf?dl=0 name url Word2Vec https://papers.nips.cc/paper/5021-distributed-representations-of-words-and-phrases-and-their-compositionality.pdf name url SGNS https://papers.nips.cc/paper/2014/file/feab05aa91085b7a8012516bc3533958-Paper.pdf date topics readings presentations Feb.<br>11, 12 name url Natural Language Processing II https://www.dropbox.com/s/bjxvre1d3w30iqj/Week5-DL4NLP-part1.pdf?dl=0 name url CNN for sentence classification https://arxiv.org/abs/1408.5882 name url Seq2Seq https://arxiv.org/abs/1409.3215 name url Tree LSTM https://arxiv.org/abs/1503.00075 name url CNN Multi-task Learning https://ronan.collobert.com/pub/matos/2008_nlp_icml.pdf date topics homeworks Feb.<br>18, 19 Q & A for Projects name url Instruction https://www.dropbox.com/s/j2w4cpq14jypkbe/HW2.pdf?dl=0 name url Kaggle https://www.kaggle.com/c/math80600aw21 date topics readings presentations Mar.<br>4, 5 name url Natural Language Processing III https://www.dropbox.com/s/366364m5gmu6gkd/Week7-DL4NLP-part2.pdf?dl=0 name url Attention Seq2Seq https://arxiv.org/abs/1409.0473 name url Transformer https://papers.nips.cc/paper/7181-attention-is-all-you-need.pdf name url Memory Networks https://arxiv.org/abs/1503.08895 name url SQuAD Dataset https://arxiv.org/abs/1606.05250 name url GLUE Benchmark https://arxiv.org/abs/1804.07461 date topics readings presentations Mar.<br>11, 12 name url Natural Language Processing IV https://www.dropbox.com/s/gcd1bu7bxd5gigm/Week8-DL4NLP-part3.pptx?dl=0 name url BERT https://arxiv.org/abs/1810.04805 name url GPT-3 https://arxiv.org/abs/2005.14165 name url RoBERTa https://arxiv.org/pdf/1907.11692 date topics readings presentations Mar.<br>18, 19 name url Graph Representation Learning I https://www.dropbox.com/s/3e09x5i9wyn8q3c/Week9-Graph-part1.pdf?dl=0 name url DeepWalk https://arxiv.org/abs/1403.6652 name url LINE https://arxiv.org/abs/1503.03578 name url Node2Vec https://arxiv.org/abs/1607.00653 name url Metapath2Vec https://ericdongyx.github.io/papers/KDD17-dong-chawla-swami-metapath2vec.pdf name url LargeVis https://arxiv.org/abs/1602.00370 date topics readings presentations Mar.<br>25, 26 name url Graph Representation Learning II https://www.dropbox.com/s/nf4ohrqjqg7rb66/Week10-Graph-part2.pdf?dl=0 name url Graph Convolutional Networks https://arxiv.org/abs/1609.02907 name url Graph Attention Networks https://arxiv.org/abs/1710.10903 name url Neural Message Passing https://arxiv.org/abs/1704.01212 name url Graph Isomorphism Network https://arxiv.org/pdf/1810.00826 name url GraphSAGE https://arxiv.org/abs/1706.02216 name url PinSAGE https://arxiv.org/abs/1806.01973 name url HAN https://arxiv.org/abs/1903.07293 date topics readings presentations Apr.<br>1, 9 Recommender Systems name url Bayesian Personalized Ranking https://arxiv.org/abs/1205.2618 name url Factorization Machines https://www.csie.ntu.edu.tw/~b97053/paper/Rendle2010FM.pdf name url RNN-based recommendations https://arxiv.org/abs/1511.06939 name url NCF https://arxiv.org/abs/1708.05031 name url AutoInt https://arxiv.org/abs/1810.11921 name url DGRec https://arxiv.org/abs/1902.09362 date topics Apr.<br>8, 16 Poster Sessions

Schedule for In-class Presentations

{% for week in page.schedule %} {% endfor %}

Date	Topic	Suggested Readings	Reference	Homework
{{ week.date }}	{% for topic in week.topics %} {% include href item=topic %} {% endfor %}	{% for reading in week.readings %} {% include href item=reading %} {% endfor %}	{% for presentation in week.presentations %} {% include href item=presentation %} {% endfor %}	{% for homework in week.homeworks %} {% include href item=homework %} {% endfor %}