Home > Store

Machine Vision, GANs, and Deep Reinforcement Learning LiveLessons, 2nd Edition

Machine Vision, GANs, and Deep Reinforcement Learning LiveLessons, 2nd Edition

Your browser doesn't support playback of this video. Please download the file to view it.

Online Video

Register your product to gain access to bonus material or receive a coupon.


  • Copyright 2020
  • Edition: 2nd
  • Online Video
  • ISBN-10: 0-13-662022-1
  • ISBN-13: 978-0-13-662022-8

6 Hours of Video Instruction

An intuitive introduction to the latest superhuman capabilities facilitated by Deep Learning.


Machine Vision, GANs, Deep Reinforcement Learning LiveLessons is an introduction to three of the most exciting topics in Deep Learning today. Modern machine vision involves automated systems outperforming humans on image recognition, object detection, and image segmentation tasks. Generative Adversarial Networks cast two Deep Learning networks against each other in a “forger-detective” relationship, enabling the fabrication of stunning, photorealistic images with flexible, user-specifiable elements. Deep Reinforcement Learning has produced equally surprising advances, including the bulk of the most widely-publicized “artificial intelligence” breakthroughs. Deep RL involves training an “agent” to become adept in given “environments,” enabling algorithms to meet or surpass human-level performance on a diverse range of complex challenges, including Atari video games, the board game Go, and subtle hand-manipulation tasks. Throughout these lessons, essential theory is brought to life with intuitive explanations and interactive, hands-on Jupyter notebook demos. Examples feature Python and straightforward Keras layers in TensorFlow 2, the most popular Deep Learning library.

Skill Level

  • Intermediate

Learn How To
  • Understand the high-level theory and key language around machine vision, deep reinforcement learning, and generative adversarial networks
  • Create state-of-the art models for image recognition, object detection, and image segmentation
  • Architect GANs that create convincing images in the style of human-drawn illustrations
  • Build deep RL agents that become adept at performing in a wide variety of environments, such as those provided by OpenAI Gym
  • Run automated experiments for optimizing deep reinforcement learning agent hyperparameters, such as its artificial-neural-network configuration
  • Appreciate what the current limitations of “artificial intelligence” are and how they may be overcome in the near future

Who Should Take This Course
  • Perfectly suited to software engineers, data scientists, analysts, and statisticians with an interest in applying Deep Learning to natural language data
  • Code examples are provided in Python, so familiarity with it or another object-oriented programming language would be helpful

Course Requirements
  • The author’s Deep Learning with TensorFlow, Keras, and PyTorch LiveLessons, or familiarity with the topics covered in Chapters 5 through 9 of his book Deep Learning Illustrated, are a prerequisite.

Lesson Descriptions

Lesson 1:  Orientation
Lesson 1 starts with a quick review of how to run the code in the lessons. It then reviews the foundational deep learning theory that is essential for building machine vision, GANs, and deep reinforcement learning specializations. The lesson wraps up with a sneak peek at the cutting-edge capabilities that will be developed over the course of all five LiveLessons.

Lesson 2: Convolutional Neural Networks for Machine Vision
Lesson 2 introduces convolutional layers. Convolutional layers are first used to create ConvNets in TensorFlow. The lesson then covers the gamut of machine learning applications, including residual networks, image segmentation, object detection, transfer learning, and capsule networks.

Lesson 3: Generative Adversarial Networks for Creativity
Lesson 3 begins with the applications of and essential theory behind generative adversarial networks (GANs). You then are shown the Quick Draw! Game, which is used as a source of hundreds of thousands of hand-drawn images from a single class for a GAN to learn how to imitate. The rest of the lesson is spent developing the intricate code for the three primary components of a GAN: the discriminator network, the generator network, and the adversarial network that pits them against each other.

Lesson 4: Deep Reinforcement Learning
Lesson 4 begins with a definition of deep reinforcement learning, then turns to an overview of its applications. The lesson wraps up with a discussion of the relationship of deep reinforcement learning to artificial intelligence.

Lesson 5: Deep Q-Learning and Beyond
Lesson 5 starts with the Cart-Pole game, which is used in the lesson to train the deep reinforcement learning algorithms. Then it turns to the theory behind deep reinforcement learning as well as deep Q-learning, a popular type of deep reinforcement learning agent.
With this theory under your belt you will be able to understand at an intuitive level the code that you subsequently when you define your own DQN agent and have it excel at the Cart-Pole game. The lesson wraps up by exploring a tool for optimizing deep reinforcement learning agent hyperparameters, introducing agents beyond DQN agents, outlining some possible project ideas, and return to the discussion of artificial intelligence to address the limitations of contemporary deep learning approaches.

About Pearson Video Training

Pearson publishes expert-led video tutorials covering a wide selection of technology topics designed to teach you the skills you need to succeed. These professional and personal technology videos feature world-leading author instructors published by your trusted technology brands: Addison-Wesley, Cisco Press, Pearson IT Certification, Prentice Hall, Sams, and Que Topics include: IT Certification, Network Security, Cisco Technology, Programming, Web Development, Mobile Development, and more.  Learn more about Pearson Video training at  http://www.informit.com/video.

Video Lessons are available for download for offline viewing within the streaming format. Look for the green arrow in each lesson.

Sample Content

Table of Contents


Lesson 1:  Orientation
1.1  Running the Hands-On Code Examples in Jupyter Notebooks
1.2  Review of Prerequisite Deep Learning Theory
1.3  A Sneak Peak

Lesson 2:  Convolutional Neural Networks for Machine Vision
2.1  Convolutional Layers
2.2  Convolutional Filter Hyperparameters
2.3  Activation Pooling and Flattening
2.4  Building A ConvNet in TensorFlow
2.5  ConvNet Model Architectures
2.6  Residual Networks
2.7  Image Segmentation
2.8  Object Detection
2.9  Transfer Learning
2.10  Capsule Networks

Lesson 3:  Generative Adversarial Networks for Creativity
3.1  A Boozy All-Nighter
3.2  Latent Space: Arithmetic on Fake Human Faces
3.3  Style Transfer: Converting Photos into Monet (and Vice Versa)
3.4  Applications of GANs
3.5  Essential GAN Theory
3.6  The "Quick, Draw!" Dataset
3.7  The Discriminator Network
3.8  The Generator Network
3.9  Training the Adversarial Network

Lesson 4:  Deep Reinforcement Learning
4.1  Three Categories of Machine Learning Problems
4.2  When Reinforcement Learning Becomes Deep
4.3  Applications to Video Games
4.4  Applications to Board Games
4.5  Real-World Applications
4.6  Reinforcement Learning Environments
4.7  Three Categories of Artificial Intelligence

Lesson 5:  Deep Q-Learning and Beyond
5.1  The Cart-Pole Game
5.2  Essential Reinforcement Learning Theory
5.3  Deep Q-Learning Networks
5.4  Defining a DQN Agent
5.5  Interacting with an Environment
5.6  Hyperparameter Optimization with SLM Lab
5.7  Agents Beyond DQN
5.8  Datasets, Project Ideas, and Resources for Self-Study
5.9  Approaching Artificial General Intelligence



Submit Errata

More Information

Unlimited one-month access with your purchase
Free Safari Membership