Course curriculum

  • 1

    Introduction to Course

    • Introduction to Instructor and Aisciences
    • Introduction To Instructor
    • Focus of the Course
  • 2

    Applications of RNN (Motivation)

    • Human Activity Recognition
    • Image Captioning
    • Machine Translation
    • Speech Recognition
    • Stock Price Predictions
    • When to Model RNN
    • Activity
  • 3

    DNN Overview

    • PyTorch Installation and Tensors Introduction
    • Why PyTorch
    • Automatic Diffrenciation Pytorch New
    • Why DNNs in Machine Learning
    • Representational Power and Data Utilization Capacity of DNN
    • Perceptron
    • Perceptron Exercise
    • Perceptron Exercise Solution
    • Perceptron Implementation
    • DNN Architecture
    • DNN Architecture Exercise
    • DNN Architecture Exercise Solution
    • DNN ForwardStep Implementation
    • DNN Why Activation Function Is Required
    • DNN Why Activation Function Is Required Exercise
    • DNN Why Activation Function Is Required Exercise Solution
    • DNN Properties Of Activation Function
    • DNN Activation Functions In Pytorch
    • DNN What Is Loss Function
    • DNN What Is Loss Function Exercise
    • DNN What Is Loss Function Exercise Solution
    • DNN What Is Loss Function Exercise 02
    • DNN What Is Loss Function Exercise 02 Solution
    • DNN Loss Function In Pytorch
    • DNN Gradient Descent
    • DNN Gradient Descent Exercise
    • DNN Gradient Descent Exercise Solution
    • DNN Gradient Descent Implementation
    • DNN Gradient Descent Stochastic Batch Minibatch
    • DNN Gradient Descent Summary
    • DNN Implemenation Gradient Step
    • DNN Implemenation Stochastic Gradient Descent
    • DNN Implemenation Batch Gradient Descent
    • DNN Implemenation Minibatch Gradient Descent
    • DNN Implemenation In PyTorch
    • DNN Weights Initializations
    • DNN Learning Rate
    • DNN Batch Normalization
    • DNN batch Normalization Implementation
    • DNN Optimizations
    • DNN Dropout
    • DNN Dropout In PyTorch
    • DNN Early Stopping
    • DNN Hyperparameters
    • DNN Pytorch CIFAR10 Example
  • 4

    RNN Architecture

    • Introduction to Module
    • Fixed Length Memory Model
    • Fixed Length Memory Model Exercise
    • Fixed Length Memory Model Exercise Solution Part 01
    • Fixed Length Memory Model Exercise Solution Part 02
    • Infinite Memory Architecture
    • Infinite Memory Architecture Exercise
    • Infinite Memory Architecture Solution
    • Weight Sharing
    • Notations
    • ManyToMany Model
    • ManyToMany Model Exercise 01
    • ManyToMany Model Solution 01
    • ManyToMany Model Exercise 02
    • ManyToMany Model Solution 02
    • OneToMany Model
    • OneToMany Model Exercise
    • OneToMany Model Solution
    • ManyToOne Model
    • ManyToOne Model Exercise
    • ManyToOne Model Solution
    • Activity Many to One
    • Activity Many to One Exercise
    • Activity Many to One Solution
    • ManyToMany Different Sizes Model
    • Activity Many to Many Nmt
    • Models Summary
    • Deep RNNs
    • Deep RNNs Exercise
    • Deep RNNs Solution
  • 5

    Gradient Decsent in RNN

    • Introduction to Gradient Descent Module
    • Example Setup
    • Equations
    • Equations Exercise
    • Equations Solution
    • Loss Function
    • Why Gradients
    • Why Gradients Exercise
    • Why Gradients Solution
    • Chain Rule
    • Chain Rule in Action
    • BackPropagation Through Time
    • Activity
  • 6

    RNN Implementation

    • Automatic Diffrenciation
    • Automatic Diffrenciation Pytorch
    • Language Modeling Next Word Prediction Vocabulary Index
    • Language Modeling Next Word Prediction Vocabulary Index Embeddings
    • Language Modeling Next Word Prediction RNN Architecture
    • Language Modeling Next Word Prediction Python 1
    • Language Modeling Next Word Prediction Python 2
    • Language Modeling Next Word Prediction Python 3
    • Language Modeling Next Word Prediction Python 4
    • Language Modeling Next Word Prediction Python 5
    • Language Modeling Next Word Prediction Python 6
  • 7

    Sentiment Classification using RNN

    • Vocabulary Implementation
    • Vocabulary Implementation Helpers
    • Vocabulary Implementation From File
    • Vectorizer
    • RNN Setup 1
    • RNN Setup 2
    • WhatNext
  • 8

    Vanishing Gradients in RNN

    • Introduction to Better RNNs Module
    • Introduction Vanishing Gradients in RNN
    • GRU
    • GRU Optional
    • LSTM
    • LSTM Optional
    • Bidirectional RNN
    • Attention Model
    • Attention Model Optional
  • 9

    TensorFlow

    • Introduction to TensorFlow
    • TensorFlow Text Classification Example using RNN
  • 10

    Project I: Book Writer

    • Introduction
    • Data Mapping
    • Modling RNN Architecture
    • Modling RNN Model in TensorFlow
    • Modling RNN Model Training
    • Modling RNN Model Text Generation
    • Activity
  • 11

    Project II: Stock Price Prediction

    • Problem Statement
    • Data Set
    • Data Prepration
    • RNN Model Training and Evaluation
    • Activity
  • 12

    Further Readings and Resourses

    • Further Readings and Resourses 1