Deep Learning and the Game of Go (eBook)

SummaryDeep Learning and the Game of Go teaches you how to apply the power of deep learning to complex reasoning tasks by building a Go-playing AI. After exposing you to the foundations of machine and deep learning, you'll use Python to build a bot and then teach it the rules of the game.Foreword by Thore Graepel, DeepMindPurchase of the print book includes a free eBook in PDF, Kindle, and ePub formats from Manning Publications.About the TechnologyThe ancient strategy game of Go is an incredible case study for AI. In 2016, a deep learning-based system shocked the Go world by defeating a world champion. Shortly after that, the upgraded AlphaGo Zero crushed the original bot by using deep reinforcement learning to master the game. Now, you can learn those same deep learning techniques by building your own Go bot!About the BookDeep Learning and the Game of Go introduces deep learning by teaching you to build a Go-winning bot. As you progress, you'll apply increasingly complex training techniques and strategies using the Python deep learning library Keras. You'll enjoy watching your bot master the game of Go, and along the way, you'll discover how to apply your new deep learning skills to a wide range of other scenarios!What's insideBuild and teach a self-improving game AIEnhance classical game AI systems with deep learningImplement neural networks for deep learningAbout the ReaderAll you need are basic Python skills and high school-level math. No deep learning experience required.About the AuthorMax Pumperla and Kevin Ferguson are experienced deep learning specialists skilled in distributed systems and data science. Together, Max and Kevin built the open source bot BetaGo.Table of ContentsPART 1 - FOUNDATIONSToward deep learning: a machine-learning introductionGo as a machine-learning problemImplementing your first Go botPART 2 - MACHINE LEARNING AND GAME AIPlaying games with tree searchGetting started with neural networksDesigning a neural network for Go dataLearning from data: a deep-learning botDeploying bots in the wildLearning by practice: reinforcement learningReinforcement learning with policy gradientsReinforcement learning with value methodsReinforcement learning with actor-critic methodsPART 3 - GREATER THAN THE SUM OF ITS PARTSAlphaGo: Bringing it all togetherAlphaGo Zero: Integrating tree search with reinforcement learning