The control and estimation of continuous-time/continuous-space nonlinear systems continues to be a challenging problem, and this is one of the c- tral foci of this book. A common approach is to use dynamic programming; this typically leads to solution of the control or estimation problem via the solution of a corresponding Hamilton–Jacobi (HJ) partial di?erential eq- tion (PDE). This approach has the advantage of producing the “optimal” control. (The term “optimal” has a somewhat more complex meaning in the class of H problems. However, we will freely use the term for such controllers ? throughout, and this meaning will be made more precise when it is not ob- ous. )Thus,insolvingthecontrol/estimationproblem,wewillbesolvingsome nonlinear HJ PDEs. One might note that a second focus of the book is the solution of a class of HJ PDEs whose viscosity solutions have interpretations as value functions of associated control problems. Note that we will brie?y discuss the notion of viscosity solution of a nonlinear HJ PDE, and indicate that this solution has the property that it is the correct weak solution of the PDE. By correct weak solution in this context, we mean that it is the solution that is the value function of the associated control (or estimation) problem. The viscosity solution is also the correct weak solution in many PDE classes not considered here, and references to further literature on this subject will be given.

In view of Professor Wendell Fleming's many fundamental contributions, his profound influence on the mathematical and systems theory communi­ ties, his service to the profession, and his dedication to mathematics, we have invited a number of leading experts in the fields of control, optimiza­ tion, and stochastic systems to contribute to this volume in his honor on the occasion of his 70th birthday. These papers focus on various aspects of stochastic analysis, control theory and optimization, and applications. They include authoritative expositions and surveys as well as research papers on recent and important issues. The papers are grouped according to the following four major themes: (1) large deviations, risk sensitive and Hoc control, (2) partial differential equations and viscosity solutions, (3) stochastic control, filtering and parameter esti­ mation, and (4) mathematical finance and other applications. We express our deep gratitude to all of the authors for their invaluable contributions, and to the referees for their careful and timely reviews. We thank Harold Kushner for having graciously agreed to undertake the task of writing the foreword. Particular thanks go to H. Thomas Banks for his help, advice and suggestions during the entire preparation process, as well as for the generous support of the Center for Research in Scientific Computation. The assistance from the Birkhauser professional staff is also greatly appreciated.

The control and estimation of continuous-time/continuous-space nonlinear systems continues to be a challenging problem, and this is one of the c- tral foci of this book. A common approach is to use dynamic programming; this typically leads to solution of the control or estimation problem via the solution of a corresponding Hamilton–Jacobi (HJ) partial di?erential eq- tion (PDE). This approach has the advantage of producing the “optimal” control. (The term “optimal” has a somewhat more complex meaning in the class of H problems. However, we will freely use the term for such controllers ? throughout, and this meaning will be made more precise when it is not ob- ous. )Thus,insolvingthecontrol/estimationproblem,wewillbesolvingsome nonlinear HJ PDEs. One might note that a second focus of the book is the solution of a class of HJ PDEs whose viscosity solutions have interpretations as value functions of associated control problems. Note that we will brie?y discuss the notion of viscosity solution of a nonlinear HJ PDE, and indicate that this solution has the property that it is the correct weak solution of the PDE. By correct weak solution in this context, we mean that it is the solution that is the value function of the associated control (or estimation) problem. The viscosity solution is also the correct weak solution in many PDE classes not considered here, and references to further literature on this subject will be given.

The rising tide of threats, from financial cybercrime to asymmetric military conflicts, demands greater sophistication in tools and techniques of law enforcement, commercial and domestic security professionals, and terrorism prevention. Concentrating on computational solutions to determine or anticipate an adversary''s intent, Adversarial Reasoning:

The rising tide of threats, from financial cybercrime to asymmetric military conflicts, demands greater sophistication in tools and techniques of law enforcement, commercial and domestic security professionals, and terrorism prevention. Concentrating on computational solutions to determine or anticipate an adversary''s intent, Adversarial Reasoning:

In view of Professor Wendell Fleming''s many fundamental contributions, his profound influence on the mathematical and systems theory communi­ ties, his service to the profession, and his dedication to mathematics, we have invited a number of leading experts in the fields of control, optimiza­ tion, and stochastic systems to contribute to this volume in his honor on the occasion of his 70th birthday. These papers focus on various aspects of stochastic analysis, control theory and optimization, and applications. They include authoritative expositions and surveys as well as research papers on recent and important issues. The papers are grouped according to the following four major themes: (1) large deviations, risk sensitive and Hoc control, (2) partial differential equations and viscosity solutions, (3) stochastic control, filtering and parameter esti­ mation, and (4) mathematical finance and other applications. We express our deep gratitude to all of the authors for their invaluable contributions, and to the referees for their careful and timely reviews. We thank Harold Kushner for having graciously agreed to undertake the task of writing the foreword. Particular thanks go to H. Thomas Banks for his help, advice and suggestions during the entire preparation process, as well as for the generous support of the Center for Research in Scientific Computation. The assistance from the Birkhauser professional staff is also greatly appreciated.

In view of Professor Wendell Fleming's many fundamental contributions, his profound influence on the mathematical and systems theory communi­ ties, his service to the profession, and his dedication to mathematics, we have invited a number of leading experts in the fields of control, optimiza­ tion, and stochastic systems to contribute to this volume in his honor on the occasion of his 70th birthday. These papers focus on various aspects of stochastic analysis, control theory and optimization, and applications. They include authoritative expositions and surveys as well as research papers on recent and important issues. The papers are grouped according to the following four major themes: (1) large deviations, risk sensitive and Hoc control, (2) partial differential equations and viscosity solutions, (3) stochastic control, filtering and parameter esti­ mation, and (4) mathematical finance and other applications. We express our deep gratitude to all of the authors for their invaluable contributions, and to the referees for their careful and timely reviews. We thank Harold Kushner for having graciously agreed to undertake the task of writing the foreword. Particular thanks go to H. Thomas Banks for his help, advice and suggestions during the entire preparation process, as well as for the generous support of the Center for Research in Scientific Computation. The assistance from the Birkhauser professional staff is also greatly appreciated.

The rising tide of threats, from financial cybercrime to asymmetric military conflicts, demands greater sophistication in tools and techniques of law enforcement, commercial and domestic security professionals, and terrorism prevention. Concentrating on computational solutions to determine or anticipate an adversary's intent, Adversarial Reasoning: Computational Approaches to Reading the Opponent's Mind discusses the technologies for opponent strategy prediction, plan recognition, deception discovery and planning, and strategy formulation that not only applies to security issues but also to game industry and business transactions.Addressing a broad range of practical problems, including military planning and command, military and foreign intelligence, antiterrorism, network security, as well as simulation and training systems, this reference presents an overview of each problem and then explores various approaches and applications to understand the minds and negate the actions of your opponents. The techniques discussed originate from a variety of disciplines such as stochastic processes, artificial intelligence planning, cognitive modeling, robotics and agent theory, robust control, game theory, and machine learning, among others. The beginning chapters outline the key concepts related to discovering the opponent's intent and plans while the later chapters journey into mathematical methods for counterdeception. The final chapters employ a range of techniques, including reinforcement learning within a stochastic dynamic games context to devise strategies that combat opponents.By answering specific questions on how to create practical applications that require elements of adversarial reasoning while also exploring theoretical developments, Adversarial Reasoning: Computational Approaches to Reading the Opponent's Mind is beneficial for practitioners as well as researchers.

This work presents recent mathematical methods in the area of optimal control with a particular emphasis on the computational aspects and applications. Optimal control theory concerns the determination of control strategies for complex dynamical systems, in order to optimize some measure of their performance. Started in the 60's under the pressure of the "space race" between the US and the former USSR, the field now has a far wider scope, and embraces a variety of areas ranging from process control to traffic flow optimization, renewable resources exploitation and management of financial markets. These emerging applications require more and more efficient numerical methods for their solution, a very difficult task due the huge number of variables. The chapters of this volume give an up-to-date presentation of several recent methods in this area including fast dynamic programming algorithms, model predictive control and max-plus techniques. This book is addressed to researchers, graduate students and applied scientists working in the area of control problems, differential games  and their applications.

The control and estimation of continuous-time/continuous-space nonlinear systems continues to be a challenging problem, and this is one of the c- tral foci of this book. A common approach is to use dynamic programming; this typically leads to solution of the control or estimation problem via the solution of a corresponding Hamilton–Jacobi (HJ) partial di?erential eq- tion (PDE). This approach has the advantage of producing the “optimal” control. (The term “optimal” has a somewhat more complex meaning in the class of H problems. However, we will freely use the term for such controllers ? throughout, and this meaning will be made more precise when it is not ob- ous. )Thus,insolvingthecontrol/estimationproblem,wewillbesolvingsome nonlinear HJ PDEs. One might note that a second focus of the book is the solution of a class of HJ PDEs whose viscosity solutions have interpretations as value functions of associated control problems. Note that we will brie?y discuss the notion of viscosity solution of a nonlinear HJ PDE, and indicate that this solution has the property that it is the correct weak solution of the PDE. By correct weak solution in this context, we mean that it is the solution that is the value function of the associated control (or estimation) problem. The viscosity solution is also the correct weak solution in many PDE classes not considered here, and references to further literature on this subject will be given.

In view of Professor Wendell Fleming's many fundamental contributions, his profound influence on the mathematical and systems theory communi­ ties, his service to the profession, and his dedication to mathematics, we have invited a number of leading experts in the fields of control, optimiza­ tion, and stochastic systems to contribute to this volume in his honor on the occasion of his 70th birthday. These papers focus on various aspects of stochastic analysis, control theory and optimization, and applications. They include authoritative expositions and surveys as well as research papers on recent and important issues. The papers are grouped according to the following four major themes: (1) large deviations, risk sensitive and Hoc control, (2) partial differential equations and viscosity solutions, (3) stochastic control, filtering and parameter esti­ mation, and (4) mathematical finance and other applications. We express our deep gratitude to all of the authors for their invaluable contributions, and to the referees for their careful and timely reviews. We thank Harold Kushner for having graciously agreed to undertake the task of writing the foreword. Particular thanks go to H. Thomas Banks for his help, advice and suggestions during the entire preparation process, as well as for the generous support of the Center for Research in Scientific Computation. The assistance from the Birkhauser professional staff is also greatly appreciated.

The control and estimation of continuous-time/continuous-space nonlinear systems continues to be a challenging problem, and this is one of the c- tral foci of this book. A common approach is to use dynamic programming; this typically leads to solution of the control or estimation problem via the solution of a corresponding Hamilton–Jacobi (HJ) partial di?erential eq- tion (PDE). This approach has the advantage of producing the “optimal” control. (The term “optimal” has a somewhat more complex meaning in the class of H problems. However, we will freely use the term for such controllers ? throughout, and this meaning will be made more precise when it is not ob- ous. )Thus,insolvingthecontrol/estimationproblem,wewillbesolvingsome nonlinear HJ PDEs. One might note that a second focus of the book is the solution of a class of HJ PDEs whose viscosity solutions have interpretations as value functions of associated control problems. Note that we will brie?y discuss the notion of viscosity solution of a nonlinear HJ PDE, and indicate that this solution has the property that it is the correct weak solution of the PDE. By correct weak solution in this context, we mean that it is the solution that is the value function of the associated control (or estimation) problem. The viscosity solution is also the correct weak solution in many PDE classes not considered here, and references to further literature on this subject will be given.

The rising tide of threats, from financial cybercrime to asymmetric military conflicts, demands greater sophistication in tools and techniques of law enforcement, commercial and domestic security professionals, and terrorism prevention. Concentrating on computational solutions to determine or anticipate an adversary''s intent, Adversarial Reasoning:

The rising tide of threats, from financial cybercrime to asymmetric military conflicts, demands greater sophistication in tools and techniques of law enforcement, commercial and domestic security professionals, and terrorism prevention. Concentrating on computational solutions to determine or anticipate an adversary''s intent, Adversarial Reasoning:

In view of Professor Wendell Fleming''s many fundamental contributions, his profound influence on the mathematical and systems theory communi­ ties, his service to the profession, and his dedication to mathematics, we have invited a number of leading experts in the fields of control, optimiza­ tion, and stochastic systems to contribute to this volume in his honor on the occasion of his 70th birthday. These papers focus on various aspects of stochastic analysis, control theory and optimization, and applications. They include authoritative expositions and surveys as well as research papers on recent and important issues. The papers are grouped according to the following four major themes: (1) large deviations, risk sensitive and Hoc control, (2) partial differential equations and viscosity solutions, (3) stochastic control, filtering and parameter esti­ mation, and (4) mathematical finance and other applications. We express our deep gratitude to all of the authors for their invaluable contributions, and to the referees for their careful and timely reviews. We thank Harold Kushner for having graciously agreed to undertake the task of writing the foreword. Particular thanks go to H. Thomas Banks for his help, advice and suggestions during the entire preparation process, as well as for the generous support of the Center for Research in Scientific Computation. The assistance from the Birkhauser professional staff is also greatly appreciated.

In view of Professor Wendell Fleming's many fundamental contributions, his profound influence on the mathematical and systems theory communi­ ties, his service to the profession, and his dedication to mathematics, we have invited a number of leading experts in the fields of control, optimiza­ tion, and stochastic systems to contribute to this volume in his honor on the occasion of his 70th birthday. These papers focus on various aspects of stochastic analysis, control theory and optimization, and applications. They include authoritative expositions and surveys as well as research papers on recent and important issues. The papers are grouped according to the following four major themes: (1) large deviations, risk sensitive and Hoc control, (2) partial differential equations and viscosity solutions, (3) stochastic control, filtering and parameter esti­ mation, and (4) mathematical finance and other applications. We express our deep gratitude to all of the authors for their invaluable contributions, and to the referees for their careful and timely reviews. We thank Harold Kushner for having graciously agreed to undertake the task of writing the foreword. Particular thanks go to H. Thomas Banks for his help, advice and suggestions during the entire preparation process, as well as for the generous support of the Center for Research in Scientific Computation. The assistance from the Birkhauser professional staff is also greatly appreciated.

The rising tide of threats, from financial cybercrime to asymmetric military conflicts, demands greater sophistication in tools and techniques of law enforcement, commercial and domestic security professionals, and terrorism prevention. Concentrating on computational solutions to determine or anticipate an adversary's intent, Adversarial Reasoning: Computational Approaches to Reading the Opponent's Mind discusses the technologies for opponent strategy prediction, plan recognition, deception discovery and planning, and strategy formulation that not only applies to security issues but also to game industry and business transactions.Addressing a broad range of practical problems, including military planning and command, military and foreign intelligence, antiterrorism, network security, as well as simulation and training systems, this reference presents an overview of each problem and then explores various approaches and applications to understand the minds and negate the actions of your opponents. The techniques discussed originate from a variety of disciplines such as stochastic processes, artificial intelligence planning, cognitive modeling, robotics and agent theory, robust control, game theory, and machine learning, among others. The beginning chapters outline the key concepts related to discovering the opponent's intent and plans while the later chapters journey into mathematical methods for counterdeception. The final chapters employ a range of techniques, including reinforcement learning within a stochastic dynamic games context to devise strategies that combat opponents.By answering specific questions on how to create practical applications that require elements of adversarial reasoning while also exploring theoretical developments, Adversarial Reasoning: Computational Approaches to Reading the Opponent's Mind is beneficial for practitioners as well as researchers.

This work presents recent mathematical methods in the area of optimal control with a particular emphasis on the computational aspects and applications. Optimal control theory concerns the determination of control strategies for complex dynamical systems, in order to optimize some measure of their performance. Started in the 60's under the pressure of the "space race" between the US and the former USSR, the field now has a far wider scope, and embraces a variety of areas ranging from process control to traffic flow optimization, renewable resources exploitation and management of financial markets. These emerging applications require more and more efficient numerical methods for their solution, a very difficult task due the huge number of variables. The chapters of this volume give an up-to-date presentation of several recent methods in this area including fast dynamic programming algorithms, model predictive control and max-plus techniques. This book is addressed to researchers, graduate students and applied scientists working in the area of control problems, differential games  and their applications.