Maxim Lapan – författare

Publisher\'s Note: This edition from 2018 is outdated and not compatible with any of the most recent updates to Python libraries. A new third edition, updated for 2020 with six new chapters that include multi-agent methods, discrete optimization, RL in robotics, and advanced exploration techniques is now available.Key FeaturesExplore deep reinforcement learning (RL), from the first principles to the latest algorithmsEvaluate high-profile RL methods, including value iteration, deep Q-networks, policy gradients, TRPO, PPO, DDPG, D4PG, evolution strategies and genetic algorithmsKeep up with the very latest industry developments, including AI-driven chatbotsBook DescriptionDeep Reinforcement Learning Hands-On is a comprehensive guide to the very latest DL tools and their limitations. You will evaluate methods including Cross-entropy and policy gradients, before applying them to real-world environments. Take on both the Atari set of virtual games and family favorites such as Connect4.The book provides an introduction to the basics of RL, giving you the know-how to code intelligent learning agents to take on a formidable array of practical tasks. Discover how to implement Q-learning on 'grid world' environments, teach your agent to buy and trade stocks, and find out how natural language models are driving the boom in chatbots.What you will learnUnderstand the DL context of RL and implement complex DL modelsLearn the foundation of RL: Markov decision processesEvaluate RL methods including Cross-entropy, DQN, Actor-Critic, TRPO, PPO, DDPG, D4PG and othersDiscover how to deal with discrete and continuous action spaces in various environmentsDefeat Atari arcade games using the value iteration methodCreate your own OpenAI Gym environment to train a stock trading agentTeach your agent to play Connect4 using AlphaGo ZeroExplore the very latest deep RL research on topics including AI-driven chatbotsWho this book is forSome fluency in Python is assumed. Basic deep learning (DL) approaches should be familiar to readers and some practical experience in DL will be helpful. This book is an introduction to deep reinforcement learning (RL) and requires no background in RL.

Maxim Lapan delivers intuitive explanations and insights into complex reinforcement learning (RL) concepts, starting from the basics of RL on simple environments and tasks to modern, state-of-the-art methodsPurchase of the print or Kindle book includes a free PDF eBookFree with your book: DRM-free PDF version + access to Packt's next-gen Reader*Key FeaturesLearn with concise explanations, modern libraries, and diverse applications from games to stock trading and web navigationDevelop deep RL models, improve their stability, and efficiently solve complex environmentsNew content on RL from human feedback (RLHF), MuZero, and transformersBook DescriptionStart your journey into reinforcement learning (RL) and reward yourself with the third edition of Deep Reinforcement Learning Hands-On. This book takes you through the basics of RL to more advanced concepts with the help of various applications, including game playing, discrete optimization, stock trading, and web browser navigation. By walking you through landmark research papers in the field, this deep RL book will equip you with practical knowledge of RL and the theoretical foundation to understand and implement most modern RL papers. The book retains its approach of providing concise and easy-to-follow explanations from the previous editions. You'll work through practical and diverse examples, from grid environments and games to stock trading and RL agents in web environments, to give you a well-rounded understanding of RL, its capabilities, and its use cases. You'll learn about key topics, such as deep Q-networks (DQNs), policy gradient methods, continuous control problems, and highly scalable, non-gradient methods. If you want to learn about RL through a practical approach using OpenAI Gym and PyTorch, concise explanations, and the incremental development of topics, then Deep Reinforcement Learning Hands-On, Third Edition, is your ideal companion*Email sign-up and proof of purchase requiredWhat you will learnStay on the cutting edge with new content on MuZero, RL with human feedback, and LLMsEvaluate RL methods, including cross-entropy, DQN, actor-critic, TRPO, PPO, DDPG, and D4PGImplement RL algorithms using PyTorch and modern RL librariesBuild and train deep Q-networks to solve complex tasks in Atari environmentsSpeed up RL models using algorithmic and engineering approachesLeverage advanced techniques like proximal policy optimization (PPO) for more stable trainingWho this book is forThis book is ideal for machine learning engineers, software engineers, and data scientists looking to learn and apply deep reinforcement learning in practice. It assumes familiarity with Python, calculus, and machine learning concepts. With practical examples and high-level overviews, it’s also suitable for experienced professionals looking to deepen their understanding of advanced deep RL methods and apply them across industries, such as gaming and finance

Revised and expanded to include multi-agent methods, discrete optimization, RL in robotics, advanced exploration techniques, and more

Key Features

Second edition of the bestselling introduction to deep reinforcement learning, expanded with six new chaptersLearn advanced exploration techniques including noisy networks, pseudo-count, and network distillation methodsApply RL methods to cheap hardware robotics platforms

Book Description

Deep Reinforcement Learning Hands-On, Second Edition is an updated and expanded version of the bestselling guide to the very latest reinforcement learning (RL) tools and techniques. It provides you with an introduction to the fundamentals of RL, along with the hands-on ability to code intelligent learning agents to perform a range of practical tasks.With six new chapters devoted to a variety of up-to-the-minute developments in RL, including discrete optimization (solving the Rubik''s Cube), multi-agent methods, Microsoft''s TextWorld environment, advanced exploration techniques, and more, you will come away from this book with a deep understanding of the latest innovations in this emerging field.In addition, you will gain actionable insights into such topic areas as deep Q-networks, policy gradient methods, continuous control problems, and highly scalable, non-gradient methods. You will also discover how to build a real hardware robot trained with RL for less than $100 and solve the Pong environment in just 30 minutes of training using step-by-step code optimization.In short, Deep Reinforcement Learning Hands-On, Second Edition, is your companion to navigating the exciting complexities of RL as it helps you attain experience and knowledge through real-world examples.

What you will learn

Understand the deep learning context of RL and implement complex deep learning modelsEvaluate RL methods including cross-entropy, DQN, actor-critic, TRPO, PPO, DDPG, D4PG, and othersBuild a practical hardware robot trained with RL methods for less than $100Discover Microsoft s TextWorld environment, which is an interactive fiction games platformUse discrete optimization in RL to solve a Rubik s CubeTeach your agent to play Connect 4 using AlphaGo ZeroExplore the very latest deep RL research on topics including AI chatbotsDiscover advanced exploration techniques, including noisy networks and network distillation techniques

Who this book is for

Some fluency in Python is assumed. Sound understanding of the fundamentals of deep learning will be helpful. This book is an introduction to deep RL and requires no background in RL

Revised and expanded to include multi-agent methods, discrete optimization, RL in robotics, advanced exploration techniques, and moreKey FeaturesSecond edition of the bestselling introduction to deep reinforcement learning, expanded with six new chaptersLearn advanced exploration techniques including noisy networks, pseudo-count, and network distillation methodsApply RL methods to cheap hardware robotics platformsBook DescriptionDeep Reinforcement Learning Hands-On, Second Edition is an updated and expanded version of the bestselling guide to the very latest reinforcement learning (RL) tools and techniques. It provides you with an introduction to the fundamentals of RL, along with the hands-on ability to code intelligent learning agents to perform a range of practical tasks.With six new chapters devoted to a variety of up-to-the-minute developments in RL, including discrete optimization (solving the Rubik's Cube), multi-agent methods, Microsoft's TextWorld environment, advanced exploration techniques, and more, you will come away from this book with a deep understanding of the latest innovations in this emerging field.In addition, you will gain actionable insights into such topic areas as deep Q-networks, policy gradient methods, continuous control problems, and highly scalable, non-gradient methods. You will also discover how to build a real hardware robot trained with RL for less than $100 and solve the Pong environment in just 30 minutes of training using step-by-step code optimization.In short, Deep Reinforcement Learning Hands-On, Second Edition, is your companion to navigating the exciting complexities of RL as it helps you attain experience and knowledge through real-world examples.What you will learnUnderstand the deep learning context of RL and implement complex deep learning modelsEvaluate RL methods including cross-entropy, DQN, actor-critic, TRPO, PPO, DDPG, D4PG, and othersBuild a practical hardware robot trained with RL methods for less than $100Discover Microsoft s TextWorld environment, which is an interactive fiction games platformUse discrete optimization in RL to solve a Rubik s CubeTeach your agent to play Connect 4 using AlphaGo ZeroExplore the very latest deep RL research on topics including AI chatbotsDiscover advanced exploration techniques, including noisy networks and network distillation techniquesWho this book is forSome fluency in Python is assumed. Sound understanding of the fundamentals of deep learning will be helpful. This book is an introduction to deep RL and requires no background in RL