Thomas J. Sargent is a Nobel prize winning economist and Professor of Economics at NYU. He has held positions at Stanford, Minnesota, Chicago, and Princeton, and served as President of the Econometric Society and of the American Economic Association. He is renowned for his influential research on macroeconomics, rational expectations, and policy analysis. John Stachurski is a Professor at the Australian National University specializing in mathematical and computational economics. As an economist he has made influential contributions to the study of Markov models and dynamic optimization. He is also a co-founder of QuantEcon, a popular platform for open source economic modelling.

• 1. Introduction; 2. Operators and Fixed Points; 3. Markov Dynamics; 4. Optimal Stopping; 5. Markov Decision Processes; 6. Stochastic Discounting; 7. Nonlinear Valuation; 8. Recursive Decision Processes; 9. Abstract Dynamic Programming; 10; Continuous Time.

Thomas J. Sargent is a Nobel prize winning economist and Professor of Economics at NYU. He has held positions at Stanford, Minnesota, Chicago, and Princeton, and served as President of the Econometric Society and of the American Economic Association. He is renowned for his influential research on macroeconomics, rational expectations, and policy analysis. John Stachurski is a Professor at the Australian National University specializing in mathematical and computational economics. As an economist he has made influential contributions to the study of Markov models and dynamic optimization. He is also a co-founder of QuantEcon, a popular platform for open source economic modelling.

• 1. Introduction; 2. Operators and Fixed Points; 3. Markov Dynamics; 4. Optimal Stopping; 5. Markov Decision Processes; 6. Stochastic Discounting; 7. Nonlinear Valuation; 8. Recursive Decision Processes; 9. Abstract Dynamic Programming; 10; Continuous Time.