119 Softmax Cross-Entropy | cipskills

Autoplay
Autocomplete

Previous Lesson Complete and Continue

Mastering Intelligence Code The Future

01 Welcome to the course

001 Why AI (5:10)
002 Introduction (3:51)

03 Q-Learning Intuition

006 Plan of Attack (4:04)
007 What is reinforcement learning (11:27)
008 The Bellman Equation (18:25)
009 The Plan (2:12)
010 Markov Decision Process (16:27)
011 Policy vs Plan (12:55)
012 Adding a Living Penalty (9:47)
013 Q-Learning Intuition (14:46)
014 Temporal Difference (19:27)
015 Q-Learning Visualization (13:31)

05 Deep Q-Learning Intuition

017 Plan of Attack (2:17)
018 Deep Q-Learning Intuition - Learning (15:15)
019 Deep Q-Learning Intuition - Acting (6:06)
020 Experience Replay (15:45)
021 Action Selection Policies (16:23)

06 Installation for Part 1

025 Windows Option 2 - Part A Installing Ubuntu on Windows (14:07)
027 Mac or Linux Installing Anaconda (7:08)
028 Mac or Linux Installing PyTorch and Kivy (6:42)
029 Kivy Installation Walk Through Mac (3:28)
030 Kivy Installation Walk Through Linux (2:18)
031 Getting Started (5:41)

07 Creating the environment

032 Self Driving Car - Step 1 (9:15)
033 Self Driving Car - Step 2 (16:18)

08 Building an AI

034 Self Driving Car - Step 3 (6:45)
035 Self Driving Car - Step 4 (14:24)
036 Self Driving Car - Step 5 (5:59)
037 Self Driving Car - Step 6 (6:01)
038 Self Driving Car - Step 7 (5:46)
039 Self Driving Car - Step 8 (10:51)
040 Self Driving Car - Step 9 (17:27)
041 Self Driving Car - Step 10 (13:51)
042 Self Driving Car - Step 11 (15:21)
043 Self Driving Car - Step 12 (12:57)
044 Self Driving Car - Step 13 (12:28)
045 Self Driving Car - Step 14 (2:53)
046 Self Driving Car - Step 15 (5:29)
047 Self Driving Car - Step 16 (7:19)

09 Playing with the AI

048 Self Driving Car - Level 1 (8:51)
049 Self Driving Car - Level 2 (4:39)
050 Self Driving Car - Level 3 (7:21)
051 Self Driving Car - Level 4 (6:09)

11 Deep Convolutional Q-Learning Intuition

054 Plan of Attack (3:27)
055 Deep Convolutional Q-Learning Intuition (7:13)
056 Eligibility Trace (8:38)

12 Installation for Part 2

059 Installing Open AI Gym Walk Through (Mac Version) (4:53)
060 Installing Open AI Gym Walk Through (Ubuntu Version) (5:36)

13 Building an AI

061 Doom - Step 1 (5:55)
062 Doom - Step 2 (9:42)
063 Doom - Step 3 (9:52)
064 Doom - Step 4 (10:35)
065 Doom - Step 5 (14:16)
066 Doom - Step 6 (6:32)
067 Doom - Step 7 (4:40)
068 Doom - Step 8 (6:39)
069 Doom - Step 9 (3:44)
070 Doom - Step 10 (7:51)
071 Doom - Step 11 (6:33)
072 Doom - Step 12 (4:14)
073 Doom - Step 13 (6:49)
074 Doom - Step 14 (15:32)
075 Doom - Step 15 (8:27)
076 Doom - Step 16 (10:38)
077 Doom - Step 17 (19:38)

14 Playing with the AI

078 Watching our AI play Doom (19:22)

16 A3C Intuition

080 Plan of Attack (3:40)
081 The three As in A3C (4:45)
082 Actor-Critic (6:36)
083 Asynchronous (11:43)
084 Advantage (15:21)
085 LSTM Layer (15:36)

18 Building an AI

087 Breakout - Step 1 (10:08)
088 Breakout - Step 2 (8:01)
089 Breakout - Step 3 (12:24)
090 Breakout - Step 4 (12:58)
091 Breakout - Step 5 (10:33)
092 Breakout - Step 6 (11:46)
093 Breakout - Step 7 (7:46)
094 Breakout - Step 8 (11:30)
095 Breakout - Step 9 (11:31)
096 Breakout - Step 10 (8:05)
097 Breakout - Step 11 (5:06)
098 Breakout - Step 12 (15:39)
099 Breakout - Step 13 (8:22)
100 Breakout - Step 14 (5:22)
101 Breakout - Step 15 (10:52)

19 Annex 1 Artificial Neural Networks

102 What is Deep Learning (12:34)
103 Plan of Attack (2:52)
104 The Neuron (16:15)
105 The Activation Function (8:29)
106 How do Neural Networks work (12:48)
107 How do Neural Networks learn (12:59)
108 Gradient Descent (10:13)
109 Stochastic Gradient Descent (8:45)
110 Backpropagation (5:22)

20 Annex 2 Convolutional Neural Networks

111 Plan of Attack (3:32)
112 What are convolutional neural networks (15:49)
113 Step 1 - Convolution Operation (16:38)
114 Step 1(b) - ReLU Layer (6:41)
115 Step 2 - Pooling (14:13)
116 Step 3 - Flattening (1:52)
117 Step 4 - Full Connection (19:25)
118 Summary (4:20)
119 Softmax Cross-Entropy (18:20)

Teach online with

119 Softmax Cross-Entropy

Lesson content locked

If you're already enrolled, you'll need to login.

Enroll in Course to Unlock