Reuven Y. Rubinstein - Böcker

This book is a comprehensive and accessible introduction to the cross-entropy (CE) method. The CE method started life around 1997 when the first author proposed an adaptive algorithm for rare-event simulation using a cross-entropy minimization technique. It was soon realized that the underlying ideas had a much wider range of application than just in rare-event simulation; they could be readily adapted to tackle quite general combinatorial and multi-extremal optimization problems, including many problems associated with the field of learning algorithms and neural computation. The book is based on an advanced undergraduate course on the CE method, given at the Israel Institute of Technology (Technion) for the last three years. It is aimed at a broad audience of engineers, computer scientists, mathematicians, statisticians and in general anyone, theorist or practitioner, who is interested in smart simulation, fast optimization, learning algorithms, image processing, etc. Our aim was to write a book on the CE method which was accessible to advanced undergraduate students and engineers who simply want to apply the CE method in their work, while at the same time accentu­ ating the unifying and novel mathematical ideas behind the CE method, so as to stimulate further research at a postgraduate level.

This accessible new edition explores the major topics in Monte Carlo simulation Simulation and the Monte Carlo Method, Second Edition reflects the latest developments in the field and presents a fully updated and comprehensive account of the major topics that have emerged in Monte Carlo simulation since the publication of the classic First Edition over twenty-five years ago. While maintaining its accessible and intuitive approach, this revised edition features a wealth of up-to-date information that facilitates a deeper understanding of problem solving across a wide array of subject areas, such as engineering, statistics, computer science, mathematics, and the physical and life sciences.The book begins with a modernized introduction that addresses the basic concepts of probability, Markov processes, and convex optimization. Subsequent chapters discuss the dramatic changes that have occurred in the field of the Monte Carlo method, with coverage of many modern topics including:Markov Chain Monte CarloVariance reduction techniques such as the transform likelihood ratio method and the screening methodThe score function method for sensitivity analysisThe stochastic approximation method and the stochastic counter-part method for Monte Carlo optimizationThe cross-entropy method to rare events estimation and combinatorial optimizationApplication of Monte Carlo techniques for counting problems, with an emphasis on the parametric minimum cross-entropy methodAn extensive range of exercises is provided at the end of each chapter, with more difficult sections and exercises marked accordingly for advanced readers. A generous sampling of applied examples is positioned throughout the book, emphasizing various areas of application, and a detailed appendix presents an introduction to exponential families, a discussion of the computational complexity of stochastic programming problems, and sample MATLAB® programs.Requiring only a basic, introductory knowledge of probability and statistics, Simulation and the Monte Carlo Method, Second Edition is an excellent text for upper-undergraduate and beginning graduate courses in simulation and Monte Carlo techniques. The book also serves as a valuable reference for professionals who would like to achieve a more formal understanding of the Monte Carlo method.

A step-by-step guide for today's modeling and simulation practices This new guide for modeling and simulation of discrete-event systems (DES) demonstrates why simulation is fast becoming the method of choice for the evaluation of system performance in science, engineering, and management. The book begins with the basics of conventional simulation, then proceeds to modern simulation-treating sensitivity analysis and optimization in a wide range of systems that exhibit complex interaction of discrete events. These include communications networks, flexible manufacturing systems, PERT (project evaluation and review techniques) networks, queueing systems, and more. Less focused on theory than on presenting a clear approach to practical applications, Modern Simulation and Modeling:* Emphasizes concepts rather than mathematical completeness* Integrates references and explanations of complex topics into the body of the text* Provides an innovative chapter on rare-event probability estimation* Describes the implementation of the score function (SF) method using the NSO simulation package* Features 40 illustrations and numerous algorithms* Offers extensive, end-of-chapter exercise sets* Includes chapter bibliographies for further reading Modern Simulation and Modeling is an essential text for graduate students of DES and stochastic processes and for undergraduate students in simulation. It is also an excellent reference for professionals in statistics and probability, mathematics, and management science.

A comprehensive account of the theory and application of Monte Carlo methodsBased on years of research in efficient Monte Carlo methods for estimation of rare-event probabilities, counting problems, and combinatorial optimization, Fast Sequential Monte Carlo Methods for Counting and Optimization is a complete illustration of fast sequential Monte Carlo techniques. The book provides an accessible overview of current work in the field of Monte Carlo methods, specifically sequential Monte Carlo techniques, for solving abstract counting and optimization problems.Written by authorities in the field, the book places emphasis on cross-entropy, minimum cross-entropy, splitting, and stochastic enumeration. Focusing on the concepts and application of Monte Carlo techniques, Fast Sequential Monte Carlo Methods for Counting and Optimization includes: Detailed algorithms needed to practice solving real-world problemsNumerous examples with Monte Carlo method produced solutions within the 1-2% limit of relative errorA new generic sequential importance sampling algorithm alongside extensive numerical resultsAn appendix focused on review material to provide additional background informationFast Sequential Monte Carlo Methods for Counting and Optimization is an excellent resource for engineers, computer scientists, mathematicians, statisticians, and readers interested in efficient simulation techniques. The book is also useful for upper-undergraduate and graduate-level courses on Monte Carlo methods.

This accessible new edition explores the major topics in Monte Carlo simulation that have arisen over the past 30 years and presents a sound foundation for problem solving Simulation and the Monte Carlo Method, Third Edition reflects the latest developments in the field and presents a fully updated and comprehensive account of the state-of-the-art theory, methods and applications that have emerged in Monte Carlo simulation since the publication of the classic First Edition over more than a quarter of a century ago. While maintaining its accessible and intuitive approach, this revised edition features a wealth of up-to-date information that facilitates a deeper understanding of problem solving across a wide array of subject areas, such as engineering, statistics, computer science, mathematics, and the physical and life sciences. The book begins with a modernized introduction that addresses the basic concepts of probability, Markov processes, and convex optimization. Subsequent chapters discuss the dramatic changes that have occurred in the field of the Monte Carlo method, with coverage of many modern topics including: Markov Chain Monte Carlo, variance reduction techniques such as importance (re-)sampling, and the transform likelihood ratio method, the score function method for sensitivity analysis, the stochastic approximation method and the stochastic counter-part method for Monte Carlo optimization, the cross-entropy method for rare events estimation and combinatorial optimization, and application of Monte Carlo techniques for counting problems. An extensive range of exercises is provided at the end of each chapter, as well as a generous sampling of applied examples.The Third Edition features a new chapter on the highly versatile splitting method, with applications to rare-event estimation, counting, sampling, and optimization. A second new chapter introduces the stochastic enumeration method, which is a new fast sequential Monte Carlo method for tree search. In addition, the Third Edition features new material on:• Random number generation, including multiple-recursive generators and the Mersenne Twister• Simulation of Gaussian processes, Brownian motion, and diffusion processes• Multilevel Monte Carlo method• New enhancements of the cross-entropy (CE) method, including the “improved” CE method, which uses sampling from the zero-variance distribution to find the optimal importance sampling parameters• Over 100 algorithms in modern pseudo code with flow control• Over 25 new exercisesSimulation and the Monte Carlo Method, Third Edition is an excellent text for upper-undergraduate and beginning graduate courses in stochastic simulation and Monte Carlo techniques. The book also serves as a valuable reference for professionals who would like to achieve a more formal understanding of the Monte Carlo method.Reuven Y. Rubinstein, DSc, was Professor Emeritus in the Faculty of Industrial Engineering and Management at Technion-Israel Institute of Technology. He served as a consultant at numerous large-scale organizations, such as IBM, Motorola, and NEC. The author of over 100 articles and six books, Dr. Rubinstein was also the inventor of the popular score-function method in simulation analysis and generic cross-entropy methods for combinatorial optimization and counting.Dirk P. Kroese, PhD, is a Professor of Mathematics and Statistics in the School of Mathematics and Physics of The University of Queensland, Australia. He has published over 100 articles and four books in a wide range of areas in applied probability and statistics, including Monte Carlo methods, cross-entropy, randomized algorithms, tele-traffic c theory, reliability, computational statistics, applied probability, and stochastic modeling.