Course curriculum
-
1
Introduction to Course
- Introduction to Instructor and Aisciences
- Introduction To Instructor
- Focus of the Course
-
2
Applications of RNN (Motivation)
- Human Activity Recognition
- Image Captioning
- Machine Translation
- Speech Recognition
- Stock Price Predictions
- When to Model RNN
- Activity
-
3
DNN Overview
- PyTorch Installation and Tensors Introduction
- Why PyTorch
- Automatic Diffrenciation Pytorch New
- Why DNNs in Machine Learning
- Representational Power and Data Utilization Capacity of DNN
- Perceptron
- Perceptron Exercise
- Perceptron Exercise Solution
- Perceptron Implementation
- DNN Architecture
- DNN Architecture Exercise
- DNN Architecture Exercise Solution
- DNN ForwardStep Implementation
- DNN Why Activation Function Is Required
- DNN Why Activation Function Is Required Exercise
- DNN Why Activation Function Is Required Exercise Solution
- DNN Properties Of Activation Function
- DNN Activation Functions In Pytorch
- DNN What Is Loss Function
- DNN What Is Loss Function Exercise
- DNN What Is Loss Function Exercise Solution
- DNN What Is Loss Function Exercise 02
- DNN What Is Loss Function Exercise 02 Solution
- DNN Loss Function In Pytorch
- DNN Gradient Descent
- DNN Gradient Descent Exercise
- DNN Gradient Descent Exercise Solution
- DNN Gradient Descent Implementation
- DNN Gradient Descent Stochastic Batch Minibatch
- DNN Gradient Descent Summary
- DNN Implemenation Gradient Step
- DNN Implemenation Stochastic Gradient Descent
- DNN Implemenation Batch Gradient Descent
- DNN Implemenation Minibatch Gradient Descent
- DNN Implemenation In PyTorch
- DNN Weights Initializations
- DNN Learning Rate
- DNN Batch Normalization
- DNN batch Normalization Implementation
- DNN Optimizations
- DNN Dropout
- DNN Dropout In PyTorch
- DNN Early Stopping
- DNN Hyperparameters
- DNN Pytorch CIFAR10 Example
-
4
RNN Architecture
- Introduction to Module
- Fixed Length Memory Model
- Fixed Length Memory Model Exercise
- Fixed Length Memory Model Exercise Solution Part 01
- Fixed Length Memory Model Exercise Solution Part 02
- Infinite Memory Architecture
- Infinite Memory Architecture Exercise
- Infinite Memory Architecture Solution
- Weight Sharing
- Notations
- ManyToMany Model
- ManyToMany Model Exercise 01
- ManyToMany Model Solution 01
- ManyToMany Model Exercise 02
- ManyToMany Model Solution 02
- OneToMany Model
- OneToMany Model Exercise
- OneToMany Model Solution
- ManyToOne Model
- ManyToOne Model Exercise
- ManyToOne Model Solution
- Activity Many to One
- Activity Many to One Exercise
- Activity Many to One Solution
- ManyToMany Different Sizes Model
- Activity Many to Many Nmt
- Models Summary
- Deep RNNs
- Deep RNNs Exercise
- Deep RNNs Solution
-
5
Gradient Decsent in RNN
- Introduction to Gradient Descent Module
- Example Setup
- Equations
- Equations Exercise
- Equations Solution
- Loss Function
- Why Gradients
- Why Gradients Exercise
- Why Gradients Solution
- Chain Rule
- Chain Rule in Action
- BackPropagation Through Time
- Activity
-
6
RNN Implementation
- Automatic Diffrenciation
- Automatic Diffrenciation Pytorch
- Language Modeling Next Word Prediction Vocabulary Index
- Language Modeling Next Word Prediction Vocabulary Index Embeddings
- Language Modeling Next Word Prediction RNN Architecture
- Language Modeling Next Word Prediction Python 1
- Language Modeling Next Word Prediction Python 2
- Language Modeling Next Word Prediction Python 3
- Language Modeling Next Word Prediction Python 4
- Language Modeling Next Word Prediction Python 5
- Language Modeling Next Word Prediction Python 6
-
7
Sentiment Classification using RNN
- Vocabulary Implementation
- Vocabulary Implementation Helpers
- Vocabulary Implementation From File
- Vectorizer
- RNN Setup 1
- RNN Setup 2
- WhatNext
-
8
Vanishing Gradients in RNN
- Introduction to Better RNNs Module
- Introduction Vanishing Gradients in RNN
- GRU
- GRU Optional
- LSTM
- LSTM Optional
- Bidirectional RNN
- Attention Model
- Attention Model Optional
-
9
TensorFlow
- Introduction to TensorFlow
- TensorFlow Text Classification Example using RNN
-
10
Project I: Book Writer
- Introduction
- Data Mapping
- Modling RNN Architecture
- Modling RNN Model in TensorFlow
- Modling RNN Model Training
- Modling RNN Model Text Generation
- Activity
-
11
Project II: Stock Price Prediction
- Problem Statement
- Data Set
- Data Prepration
- RNN Model Training and Evaluation
- Activity
-
12
Further Readings and Resourses
- Further Readings and Resourses 1