📗 -> Deep Learning - DLN
short mode
not done
tags include #class
description includes DLN🔗 Critical Links
🔶 Course Description
An Introduction to Deep Learning and Neural Networks for Senior Undergraduate and Graduate Students in Computer Science.
Topics
- Background Introduction
- ML, NN
- Optimization, Tuning
- Classic Deep Models
- Auto-Encoder
- Convolutional NN
- Recurrent NN
- Graph NN
- Latest Deep Models
- GAN
- Transformer and BERT
- Graph-Bert
❗ Important
REVIEW GAN LOSS FUNCTION, FINAL QUESTION ON IT
Instructor:
- Jiawei Zhang
- Interest in: ML, DL, data mining and big data
TA:
- TA Name - Email
- Course Instructor Name - Email
Textbook
- Required textbook: Deep Learning, 1st edition, by Ian Goodfellow and Yoshua Bengio and Aaron Courville. MIT Press, 2016.
- Recommended references:
- Neural Networks and Deep Learning: A Textbook, 1st edition, by Charu Aggarwal. Springer, 2018.
- Neural Networks and Learning Machines, 3rd edition, by Simon S. Haykin. Pearson, 2008.
- matrixcookbook.pdf
- PyTorch for Deep Learning & Machine Learning – Full Course
📄 Class Material
Week 1 -Class Intro / Intro ML
- Intro - ECS189G-L1
- ML Basics: ML Tasks, Train/Test, and SVM - ECS189G-L2
- ML Basics: SVM Classification - ECS189G-L3
- Deeper into SVMs
Week 2 - Intro ML
- ML Basics: Regression, Unsupervised (clustering) - ECS189G-L4
- ML Basics: Evaluation. Project - ECS189G-L5
- Project: ECS189G-L6
Unit 3 - Optimization / Deep Learning Intro
- Optimization: Introduction to GD and batching - ECS189G-L7
- Optimization/DL Basics: Optimizers and Intro to DL - ECS189G-L8
- DL Basics: ECS189G-L9
Unit 4 - Auto-Encoders / CNN
- Autoencoders: ECS189G-L10
- Autoencoders/CNN: ECS189G-L11
- CNN: ECS189G-L12
Unit 5 - GAN / Computer Vision
- GAN: ECS189G-L13
- GAN/Computer Vision: ECS189G-L14
- ECS189G-L15
REVIEW GAN LOSS FUNCTION, FINAL QUESTION ON IT
Unit 6 - Midterm Week / GPT
- Midterm Overview: ECS189G-L16
- Midterm
- ECS189G-L17
Unit 7 - RNN
- Recurrent Neural Network - ECS189G-L18
- MT Review and RNN - ECS189G-L19
- RNN? - ECS189G-L20
Unit 8 - RNN / Transfomers / GNN
- RNN / - ECS189G-L21
- Transformer - ECS189G-L22
- GNN - ECS189G-L23
ECS189G-Section4
Unit 9 - GNN / Networks Embeddings
- holiday
- GNN - ECS189G-L24
- Sparse notes, did not really understand
- ECS189G-L25
- Skipped, banquet
Unit 10 - DLN
- ECS189G-L26
- did not understand anything
- ECS189G-L27