• Fri frakt över 249 kr
  • •
  • Snabba leveranser
  • •
  • Billiga böcker
Kundservice

Du är på sajten för privatpersoner.

Företag, bibliotek eller offentlig verksamhet?

Du handlar på classic.bokus.com, där alla dina funktioner finns intakta.
Till classic.bokus.com
Bokus logotyp. Gå till startsidan.
  • Erbjudanden
  • Nyheter
  • Student
  • Topplistor
  • Barn & ungdom
  • Bokus Play
  • E-böcker
  • Pocketböcker
  • Spel & pussel

Upp till 20% på populära nyheter →

Sidfot

Mina sidor

    Hjälp

    • Kundservice
    • Vanliga frågor och svar
    • Frakt och leverans
    • Retur vid ångerrätt
    • Reklamera vara
    • Betalning
    • Köpvillkor
    • Allmänna villkor
    • Information om webbplatsens tillgänglighet

    Om Bokus

    • Om oss
    • Pressrum
    • För studenter
    • För företag
    • För bibliotek och offentlig verksamhet
    • För leverantörer
    • Hållbarhet

    Populärt

    • Aktuella erbjudanden
    • Presentkort
    • Studentlitteratur
    • Nya böcker
    • Topplistor
    • Signerade böcker
    • Engelska böcker

    Inspiration

    • Boktips
    • BookTok
    • Populära bokserier
    • Barnbokskaraktärer
    • Populära författare

    Mina sidor

      Hjälp

      • Kundservice
      • Vanliga frågor och svar
      • Frakt och leverans
      • Retur vid ångerrätt
      • Reklamera vara
      • Betalning
      • Köpvillkor
      • Allmänna villkor
      • Information om webbplatsens tillgänglighet

      Om Bokus

      • Om oss
      • Pressrum
      • För studenter
      • För företag
      • För bibliotek och offentlig verksamhet
      • För leverantörer
      • Hållbarhet

      Populärt

      • Aktuella erbjudanden
      • Presentkort
      • Studentlitteratur
      • Nya böcker
      • Topplistor
      • Signerade böcker
      • Engelska böcker

      Inspiration

      • Boktips
      • BookTok
      • Populära bokserier
      • Barnbokskaraktärer
      • Populära författare
      Logotyp för Bokus
      Följ oss på Facebook (extern länk)Följ oss på Instagram (extern länk)Följ oss på YouTube (extern länk)Följ oss på TikTok (extern länk)
      bokus @ CookiesIntegritetspolicyKöpvillkor
      Till Citymail hemsida (extern länk)Till Budbee hemsida (extern länk)Till Postnord hemsida (extern länk)Till Schenker hemsida (extern länk)Till Early Bird hemsida (extern länk)Till Walleys hemsida (extern länk)
      1. Naturvetenskap och teknik
      2. Teknik och industri
      3. Elektronik och kommunikationer

      Simulation-Based Algorithms for Markov Decision Processes

      AvHyeong Soo Chang,Jiaqiao Hu

      Häftad, Engelska, 2015

      Del i serien Communications and Control Engineering

      1 098 kr

      Beställningsvara. Skickas inom 10-15 vardagar. Fri frakt över 249 kr.

      Fler format och utgåvor

      Inbunden

      1 098 kr

      Häftad

      1 510 kr

      Beskrivning

      Markov decision process (MDP) models are widely used for modeling sequential decision-making problems that arise in engineering, economics, computer science, and the social sciences.  Many real-world problems modeled by MDPs have huge state and/or action spaces, giving an opening to the curse of dimensionality and so making practical solution of the resulting models intractable.  In other cases, the system of interest is too complex to allow explicit specification of some of the MDP model parameters, but simulation samples are readily available (e.g., for random transitions and costs). For these settings, various sampling and population-based algorithms have been developed to overcome the difficulties of computing an optimal solution in terms of a policy and/or value function.  Specific approaches include adaptive sampling, evolutionary policy iteration, evolutionary random policy search, and model reference adaptive search. This substantially enlarged new edition reflects the latest developments in novel algorithms and their underpinning theories, and presents an updated account of the topics that have emerged since the publication of the first edition. Includes: innovative material on MDPs, both in constrained settings and with uncertain transition properties; game-theoretic method for solving MDPs; theories for developing roll-out based algorithms; and details of approximation stochastic annealing, a population-based on-line simulation-based algorithm. The self-contained approach of this book will appeal not only to researchers in MDPs, stochastic modeling, and control, and simulation but will be a valuable source of tuition and reference for students of control and operations research.

      Produktinformation

      • Utgivningsdatum:2015-03-07
      • Mått:155 x 235 x 14 mm
      • Vikt:382 g
      • Format:Häftad
      • Språk:Engelska
      • Serie:Communications and Control Engineering
      • Antal sidor:229
      • Upplaga:2
      • Förlag:Springer London Ltd
      • ISBN:9781447159902

      Utforska kategorier

      • Elektronik och kommunikationer inom Naturvetenskap och teknik
      • Referensverk och tvärvetenskap inom Samhälle och politik
      • Matematisk statistik inom Naturvetenskap och teknik

      Mer om författaren

      Hyeong Soo Chang (SM’07 of the IEEE, Member of INFORMS) received the B.S. and M.S. degrees in electrical engineering and the Ph.D. degree in electrical and computer engineering, all from Purdue University,West Lafayette, IN, in 1994, 1996, and 2001, respectively. Since 2003, he has been with the Department of Computer Science and Engineering, Sogang University, Seoul, Korea, where he is now an Associate Professor. He has about 30 journal papers in the area of MDPs and related areas. His main research interests include Markov decision processes, Markov games, computational learning theory, computational intelligence, and stochastic optimization.  He currently serves as an Associate Editor for the IEEE Transactions on Automatic Control. Jiaqiao Hu (M’11 of the IEEE, Member of INFORMS) received the B.S. degree in automation from Shanghai Jiao Tong University, Shanghai, China, in 1997, the M.S. degree in applied mathematics from the University of Maryland, Baltimore County, in 2001, and the Ph.D. degree in electrical engineering from the University of Maryland, College Park, in 2006. Since 2006, he has been with the Department of Applied Mathematics and Statistics, State University of New York, Stony Brook, where he is currently an Assistant Professor Markov decision processes, simulation-based optimization, global optimization, applied probability, and stochastic modeling and analysis. Michael Fu (Fellow of the IEEE, Member of INFORMS) received his Ph.D. and M.S degrees in applied mathematics from Harvard University in 1989 and 1986, respectively. He received S.B. and S.M. degrees in electrical engineering and an S.B. degree in mathematics from the Massachusetts Institute of Technology in 1985. Since 1989, he has been at the University of Maryland, College Park, in the College of Business and Management.  He was the Simulation Area Editor for Operations and is an Associate Editor for Management Science, and has served on the Editorial Boards ofthe INFORMS Journal on Computing, Production and Operations Management and IIE Transactions. He was on the program committee for the Spring 1996 INFORMS National Meeting, in charge of contributed papers. In 1995, he received the Maryland Business School's annual Allen J. Krowe Award for Teaching Excellence. He is the co-author (with Jian-Qiang Hu) of the book, Conditional Monte Carlo: Gradient Estimation and Optimization Applications (0-7923-9873-4, 1997), which received the 1998 INFORMS College on Simulation Outstanding Publication Award. Other awards include the 1999 IIE Operations Research Division Award and a 1998 IIE Transactions Best Paper Award. In 2002, he received ISR's Outstanding Systems Engineering Faculty Award. He currently serves as a director of National Science Foundation Operations Research Program. Dr. Fu's research interests lie in the areas of stochastic derivative estimation and simulation optimization of discrete-event systems, particularly with applications towards manufacturing systems, inventory control, and the pricing of financial derivatives. Steven I. Marcus (Fellow of the IEEE, Fellow of SIAM, Member of INFORMS) received his Ph.D. and S.M. from the Massachusetts Institute of Technology in 1975 and 1972, respectively. He received a B.A. from Rice University in 1971. From 1975 to 1991, he was with the Department of Electrical and Computer Engineering at the University of Texas at Austin, where he was the L.B. (Preach) Meaders Professor in Engineering. He was Associate Chairman of the Department during the period 1984-89. In 1991, he joined the University of Maryland, College Park, where he was Director of the Institute for Systems Research until 1996. He is currently a Professor in the Electrical Engineering Department and the Institute for Systems Research. He has served as an Editor of the SIAM Journal on Control and Optimization, and Associate Editor of Mathematics of Control, Signals, and Systems, Journal on Discrete Event Dynamic Systems, and Acta Applicandae Mathematicae. He has authored or co-authored more than 100 articles, conference proceedings, and book chapters. Dr. Marcus's research interests lie in the areas of control and systems engineering, analysis and control of stochastic systems, Markov decision processes, stochastic and adaptive control, learning, fault detection, and discrete event systems, with applications in manufacturing, acoustics, and communication networks.

      Recensioner i media

      From the book reviews:“The book consists of five chapters. … This well-written book is addressed to researchers in MDPs and applied modeling with an interests in numerical computations, but the book is also accessible to graduate students in operation research, computer science, and economics. The authors gives many pseudocodes of algorithms, numerical examples, algorithms convergence analysis and bibliographical notes that can be very helpful for readers to understand the ideas presented in the book and to perform experiments on their own.” (Wiesław Kotarski, zbMATH, Vol. 1293, 2014)

      Innehållsförteckning

      • Markov Decision Processes.- Multi-stage Adaptive Sampling Algorithms.- Population-based Evolutionary Approaches.- Model Reference Adaptive Search.- On-line Control Methods via Simulation.- Game-theoretic Methods via Simulation.
      Hoppa över listan

      Mer från samma författare

      Steven I. Marcus, Michael C. Fu, Jiaqiao Hu, Hyeong Soo Chang - Simulation-Based Algorithms for Markov Decision Processes, E-bok

      Simulation-Based Algorithms for Markov Decision Processes

      Steven I. Marcus, Michael C. Fu, Jiaqiao Hu, Hyeong Soo Chang

      E-bok
      2013

      1 413 kr

      Steven I. Marcus, Jiaqiao Hu, Michael C. Fu, Hyeong Soo Chang - Simulation-based Algorithms for Markov Decision Processes, E-bok

      Simulation-based Algorithms for Markov Decision Processes

      Steven I. Marcus, Jiaqiao Hu, Michael C. Fu, Hyeong Soo Chang

      E-bok
      2007

      1 491 kr

      Hoppa över listan

      Mer från samma serie

      Howard Kaufman, Itzhak Barkana, Kenneth Sobel - Direct Adaptive Control Algorithms, Inbunden

      Direct Adaptive Control Algorithms

      Howard Kaufman, Itzhak Barkana, Kenneth Sobel

      Inbunden, 1997

      1 644 kr

      Viorel Barbu - Stabilization of Navier–Stokes Flows, Inbunden

      Stabilization of Navier–Stokes Flows

      Viorel Barbu

      Inbunden, 2010

      1 098 kr

      Daizhan Cheng, Hongsheng Qi, Zhiqiang Li - Analysis and Control of Boolean Networks, Inbunden

      Analysis and Control of Boolean Networks

      Daizhan Cheng, Hongsheng Qi, Zhiqiang Li

      Inbunden, 2010

      1 098 kr

      Wei Ren, Yongcan Cao - Distributed Coordination of Multi-agent Networks, Inbunden

      Distributed Coordination of Multi-agent Networks

      Wei Ren, Yongcan Cao

      Inbunden, 2010

      1 644 kr

      Zhendong Sun, Shuzhi Sam Ge - Stability Theory of Switched Dynamical Systems, Inbunden

      Stability Theory of Switched Dynamical Systems

      Zhendong Sun, Shuzhi Sam Ge

      Inbunden, 2011

      1 098 kr

      Lars Grüne, Jürgen Pannek - Nonlinear Model Predictive Control, Inbunden

      Nonlinear Model Predictive Control

      Lars Grüne, Jürgen Pannek

      Inbunden, 2011

      2 224 kr

      Iasson Karafyllis, Zhong-Ping Jiang - Stability and Stabilization of Nonlinear Systems, Inbunden

      Stability and Stabilization of Nonlinear Systems

      Iasson Karafyllis, Zhong-Ping Jiang

      Inbunden, 2011

      1 644 kr

      Bongsob Song, J. Karl Hedrick - Dynamic Surface Control of Uncertain Nonlinear Systems, Inbunden

      Dynamic Surface Control of Uncertain Nonlinear Systems

      Bongsob Song, J. Karl Hedrick

      Inbunden, 2011

      1 098 kr

      Ioan Doré Landau, Rogelio Lozano, Mohammed M'Saad, Alireza Karimi - Adaptive Control, Inbunden

      Adaptive Control

      Ioan Doré Landau, Rogelio Lozano, Mohammed M'Saad, Alireza Karimi

      Inbunden, 2011

      1 862 kr

      Aleksandar Zecevic, Dragoslav D. Siljak - Control of Complex Systems, Inbunden

      Control of Complex Systems

      Aleksandar Zecevic, Dragoslav D. Siljak

      Inbunden, 2010

      1 098 kr

      Hoppa över listan

      Du kanske också är intresserad av

      Hyeong Soo Chang, Jiaqiao Hu, Michael C. Fu, Steven I. Marcus - Simulation-Based Algorithms for Markov Decision Processes, Inbunden

      Simulation-Based Algorithms for Markov Decision Processes

      Hyeong Soo Chang, Jiaqiao Hu, Michael C. Fu, Steven I. Marcus

      Inbunden, 2013

      1 098 kr

      Hyeong Soo Chang, Michael C. Fu, Jiaqiao Hu, Steven I. Marcus - Simulation-based Algorithms for Markov Decision Processes, Häftad

      Simulation-based Algorithms for Markov Decision Processes

      Hyeong Soo Chang, Michael C. Fu, Jiaqiao Hu, Steven I. Marcus

      Häftad, 2010

      1 510 kr

      Steven I. Marcus, Michael C. Fu, Jiaqiao Hu, Hyeong Soo Chang - Simulation-Based Algorithms for Markov Decision Processes, E-bok

      Simulation-Based Algorithms for Markov Decision Processes

      Steven I. Marcus, Michael C. Fu, Jiaqiao Hu, Hyeong Soo Chang

      E-bok
      2013

      1 413 kr

      Steven I. Marcus, Jiaqiao Hu, Michael C. Fu, Hyeong Soo Chang - Simulation-based Algorithms for Markov Decision Processes, E-bok

      Simulation-based Algorithms for Markov Decision Processes

      Steven I. Marcus, Jiaqiao Hu, Michael C. Fu, Hyeong Soo Chang

      E-bok
      2007

      1 491 kr

      Michael C. Fu, Jian-Qiang Hu - Conditional Monte Carlo, Inbunden

      Conditional Monte Carlo

      Michael C. Fu, Jian-Qiang Hu

      Inbunden, 1997

      2 190 kr

      Bruce L. Golden, Michael C. Fu, Frank B. Alt - Perspectives in Operations Research, E-bok

      Perspectives in Operations Research

      Bruce L. Golden, Michael C. Fu, Frank B. Alt

      E-bok
      2006

      1 470 kr

      Frank B. Alt, Michael C. Fu, Bruce L. Golden - Perspectives in Operations Research, Inbunden

      Perspectives in Operations Research

      Frank B. Alt, Michael C. Fu, Bruce L. Golden

      Inbunden, 2006

      1 131 kr

      Saul I. Gass, Michael C. Fu - Encyclopedia of Operations Research and Management Science, Inbunden

      Encyclopedia of Operations Research and Management Science

      Saul I. Gass, Michael C. Fu

      Inbunden, 2013

      9 000 kr

      Michael C Fu - Handbook of Simulation Optimization, Inbunden
      Del 216

      Handbook of Simulation Optimization

      Michael C Fu

      Inbunden, 2014

      1 753 kr

      Michael C Fu - Handbook of Simulation Optimization, Häftad
      Del 216

      Handbook of Simulation Optimization

      Michael C Fu

      Häftad, 2016

      1 806 kr