Kurt Marti - Böcker

This book examines application and methods to incorporating stochastic parameter variations into the optimization process to decrease expense in corrective measures. Basic types of deterministic substitute problems occurring mostly in practice involve i) minimization of the expected primary costs subject to expected recourse cost constraints (reliability constraints) and remaining deterministic constraints, e.g. box constraints, as well as ii) minimization of the expected total costs (costs of construction, design, recourse costs, etc.) subject to the remaining deterministic constraints.After an introduction into the theory of dynamic control systems with random parameters, the major control laws are described, as open-loop control, closed-loop, feedback control and open-loop feedback control, used for iterative construction of feedback controls. For approximate solution of optimization and control problems with random parameters and involving expected cost/loss-type objective,constraint functions, Taylor expansion procedures, and Homotopy methods are considered, Examples and applications to stochastic optimization of regulators are given. Moreover, for reliability-based analysis and optimal design problems, corresponding optimization-based limit state functions are constructed. Because of the complexity of concrete optimization/control problems and their lack of the mathematical regularity as required of Mathematical Programming (MP) techniques, other optimization techniques, like random search methods (RSM) became increasingly important.Basic results on the convergence and convergence rates of random search methods are presented. Moreover, for the improvement of the – sometimes very low – convergence rate of RSM, search methods based on optimal stochastic decision processes are presented. In order to improve the convergence behavior of RSM, the random search procedure is embedded into a stochastic decision process for an optimal control ofthe probability distributions of the search variates (mutation random variables).

This book examines application and methods to incorporating stochastic parameter variations into the optimization process to decrease expense in corrective measures. Basic types of deterministic substitute problems occurring mostly in practice involve i) minimization of the expected primary costs subject to expected recourse cost constraints (reliability constraints) and remaining deterministic constraints, e.g. box constraints, as well as ii) minimization of the expected total costs (costs of construction, design, recourse costs, etc.) subject to the remaining deterministic constraints.After an introduction into the theory of dynamic control systems with random parameters, the major control laws are described, as open-loop control, closed-loop, feedback control and open-loop feedback control, used for iterative construction of feedback controls. For approximate solution of optimization and control problems with random parameters and involving expected cost/loss-type objective,constraint functions, Taylor expansion procedures, and Homotopy methods are considered, Examples and applications to stochastic optimization of regulators are given. Moreover, for reliability-based analysis and optimal design problems, corresponding optimization-based limit state functions are constructed. Because of the complexity of concrete optimization/control problems and their lack of the mathematical regularity as required of Mathematical Programming (MP) techniques, other optimization techniques, like random search methods (RSM) became increasingly important.Basic results on the convergence and convergence rates of random search methods are presented. Moreover, for the improvement of the – sometimes very low – convergence rate of RSM, search methods based on optimal stochastic decision processes are presented. In order to improve the convergence behavior of RSM, the random search procedure is embedded into a stochastic decision process for an optimal control ofthe probability distributions of the search variates (mutation random variables).

This book examines optimization problems that in practice involve random model parameters. It outlines the computation of robust optimal solutions, i.e., optimal solutions that are insensitive to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into corresponding deterministic problems.Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures, and differentiation formulas for probabilities and expectations.The fourth edition of this classic text has been carefully and thoroughly revised. It includes new chapters on the solution of stochastic linear programs by discretization of the underlying probability distribution, and on solving deterministic optimization problems by means of controlled random search methods and multiple random search procedures. It also presents a new application of stochastic optimization methods to machine learning problems with different loss functions. For the computation of optimal feedback controls under stochastic uncertainty, besides the open-loop feedback procedures, a new method based on Taylor expansions with respect to the gain parameters is presented. The book is intended for researchers and graduate students who are interested in stochastics, stochastic optimization, and control. It will also benefit professionals and practitioners whose work involves technical, economicand/or operations research problems under stochastic uncertainty.

This book examines optimization problems that in practice involve random model parameters. It outlines the computation of robust optimal solutions, i.e., optimal solutions that are insensitive to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into corresponding deterministic problems.Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures, and differentiation formulas for probabilities and expectations.The fourth edition of this classic text has been carefully and thoroughly revised. It includes new chapters on the solution of stochastic linear programs by discretization of the underlying probability distribution, and on solving deterministic optimization problems by means of controlled random search methods and multiple random search procedures. It also presents a new application of stochastic optimization methods to machine learning problems with different loss functions. For the computation of optimal feedback controls under stochastic uncertainty, besides the open-loop feedback procedures, a new method based on Taylor expansions with respect to the gain parameters is presented. The book is intended for researchers and graduate students who are interested in stochastics, stochastic optimization, and control. It will also benefit professionals and practitioners whose work involves technical, economicand/or operations research problems under stochastic uncertainty.

In engineering and economics a certain vector of inputs or decisions must often be chosen, subject to some constraints, such that the expected costs arising from the deviation between the output of a stochastic linear system and a desired stochastic target vector are minimal. In many cases the loss function u is convex and the occuring random variables have, at least approximately, a joint discrete distribution. Concrete problems of this type are stochastic linear programs with recourse, portfolio optimization problems, error minimization and optimal design problems. In solving stochastic optimization problems of this type by standard optimization software, the main difficulty is that the objective function F and its derivatives are defined by multiple integrals. Hence, one wants to omit, as much as possible, the time-consuming computation of derivatives of F. Using the special structure of the problem, the mathematical foundations and several concrete methods for the computation of feasible descent directions, in a certain part of the feasible domain, are presented first, without any derivatives of the objective function F. It can also be used to support other methods for solving discretely distributed stochastic programs, especially large scale linear programming and stochastic approximation methods.

Das Buch gibt eine Einführung in das neue Gebiet der Analyse und Optimierung von Tragwerken unter stochastischer Unsicherheit. Es werden die Grundlagen ausführlich dargestellt und zum Teil von unterschiedlichen Standpunkten aus beleuchtet.In Teil I wird die lineare Theorie der Stabtragwerke als Grundlage für die FEM entwickelt. Vorausgesetzt werden dabei nur wenige Kenntnisse aus  der Technischen Mechanik und der Ingenieurmathematik, insbesondere eine gewisse Vertrautheit mit der Matrizenrechnung. In Teil II wird dargestellt, wie sich die Wahrscheinlichkeitsverteilungen der Verschiebungen und Spannungen in den Knoten aus denen der stochastischen Stabparameter und äußeren Lasten – zumindest approximativ – berechnen lassen. In Teil III schließlich wird die Optimierung von Tragwerken mit stochastischen Parametern behandelt. Dazu wird ein geeignetes deterministisches Ersatzproblem des Ausgangsproblems mit stochastischen Modellparametern formuliert. Eine kurze Beschreibung einiger Optimierungsverfahren findet man im letzten Abschnitt. Besondere Mühe wurde auf die zahlreichen und eingehend behandelten Beispiele verwandt.Das Buch ist geschrieben für Studierende, praktisch tätige Ingenieure und Mathematiker.

Ongoing global changes bring fundamentally new scientific problems requiring new concepts and tools. A key issue concerns a vast variety of practically irreducible uncertainties, which challenge our traditional models and require new concepts and analytical tools. The uncertainty critically dominantes, e.g., the climate change debates. In short, the dilemma is concerned with enormous costs vs. massive uncertainties of potential extreme impacts. Traditional scientific approaches usually rely on real observations and experiments. Yet no sufficient observations exist for new problems, and "pure" experiments and learning by doing may be very expensive, dangerous, or simply impossible. In addition, available historical observations are contaminated by actions, policies. The complexity of new problems does not allow to achieve enough certainty by increasing the resolution of models or by bringing in more links. Hence, new tools for modeling and management of uncertainty are needed, as given in this book.

This volume considers optimal stochastic decision processes from the viewpoint of stochastic programming. It focuses on theoretical properties and on approximate or numerical solution techniques for time-dependent optimization problems with random parameters (multistage stochastic programs, optimal stochastic decision processes). Methods for finding approximate solutions of probabilistic and expected cost based deterministic substitute problems are presented. Besides theoretical and numerical considerations, the proceedings volume contains selected refereed papers on many practical applications to economics and engineering: risk, risk management, portfolio management, finance, insurance-matters and control of robots.

This volume includes a selection of papers presented at the GAMM/ IFIP-Workshop on IIStochastic Optimization: Numerical Methods and ll Technical Applications , held at the Federal Armed Forces Univer- sity Munich, May 29-31, 1990. The objective of this meeting was to bring together scientists from Stochastic Programming and from those Engineering areas, where Mathematical Programming models are common tools, as e.g. Optimal structural Design, Power Dispatch, Acid Rain Abatement etc .. Hence, the aim was to discuss the effects of taking into account the in- herent randomness of some data of these problems, i.e. considering Stochastic Programming instead of Mathematical Programming models in order to get solutions being more reliable, but not more expen- sive. An international programme committe2 was formed which included H.A. Eschenauer (Germany) P. Kall (Switzerland) K. Marti (Germany, Chairman) J. Mayer (Hungary) G.I. Schueller (Austria) Although the number of participants had to be small for technical reasons, the area covered by the lectures during the workshop was rather broad.It contains theoretical insight into stochastic pro- gramming problems, new computational approaches, analyses of known solution methods, and applications in such very different technical fields as ecology, energy demands, and optimal reliability of me- chanical structures. In particular, the applied presentation also pointed to several open methodological problems.

In order to obtain more reliable optimal solutions of concrete technical/economic problems, e.g. optimal design problems, the often known stochastic variations of many technical/economic parameters have to be taken into account already in the planning phase. Hence, ordinary mathematical programs have to be replaced by appropriate stochastic programs. New theoretical insight into several branches of reliability-oriented optimization of stochastic systems, new computational approaches and technical/economic applications of stochastic programming methods can be found in this volume.

Optimization problems arising in practice usually contain several random parameters. Hence, in order to obtain optimal solutions being robust with respect to random parameter variations, the mostly available statistical information about the random parameters should be considered already at the planning phase. The original problem with random parameters must be replaced by an appropriate deterministic substitute problem, and efficient numerical solution or approximation techniques have to be developed for those problems. This proceedings volume contains a selection of papers on modelling techniques, approximation methods, numerical solution procedures for stochastic optimization problems and applications to the reliability-based optimization of concrete technical or economic systems.

Support for addressing the on-going global changes needs solutions for new scientific problems which in turn require new concepts and tools. A key issue concerns a vast variety of irreducible uncertainties, including extreme events of high multidimensional consequences, e.g., the climate change. The dilemma is concerned with enormous costs versus massive uncertainties of extreme impacts. Traditional scientific approaches rely on real observations and experiments. Yet no sufficient observations exist for new problems, and "pure" experiments, and learning by doing may be expensive, dangerous, or impossible. In addition, the available historical observations are often contaminated by past actions, and policies. Thus, tools are presented for the explicit treatment of uncertainties using "synthetic" information composed of available "hard" data from historical observations, the results of possible experiments, and scientific facts, as well as "soft" data from experts' opinions, and scenarios.

Optimization problems arising in practice involve random model parameters. For the computation of robust optimal solutions, i.e., optimal solutions being insenistive with respect to random parameter variations, appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data, and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems. Due to the occurring probabilities and expectations, approximative solution techniques must be applied. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures, differentiation formulas for probabilities and expectations.

Managing safety of diverse systems requires decision-making under uncertainties and risks. Such systems are typically characterized by spatio-temporal heterogeneities, inter-dependencies, externalities, endogenous risks, discontinuities, irreversibility, practically irreducible uncertainties, and rare events with catastrophic consequences. Traditional scientific approaches rely on data from real observations and experiments; yet no sufficient observations exist for new problems, and experiments are usually impossible. Therefore, science-based support for addressing such new class of problems needs to replace the traditional “deterministic predictions” analysis by new methods and tools for designing decisions that are robust against the involved uncertainties and risks. The new methods treat uncertainties explicitly by using “synthetic” information derived by integration of “hard” elements, including available data, results of possible experiments, and formal representations of scientific facts, with “soft” elements based on diverse representations of scenarios and opinions of public, stakeholders, and experts. The volume presents such effective new methods, and illustrates their applications in different problem areas, including engineering, economy, finance, agriculture, environment, and policy making.

This book examines optimization problems that in practice involve random model parameters. It details the computation of robust optimal solutions, i.e., optimal solutions that are insensitive with respect to random parameter variations, where appropriate deterministic substitute problems are needed. Based on the probability distribution of the random data and using decision theoretical concepts, optimization problems under stochastic uncertainty are converted into appropriate deterministic substitute problems.Due to the probabilities and expectations involved, the book also shows how to apply approximative solution techniques. Several deterministic and stochastic approximation methods are provided: Taylor expansion methods, regression and response surface methods (RSM), probability inequalities, multiple linearization of survival/failure domains, discretization methods, convex approximation/deterministic descent directions/efficient points, stochastic approximation and gradient procedures and differentiation formulas for probabilities and expectations.In the third edition, this book further develops stochastic optimization methods. In particular, it now shows how to apply stochastic optimization methods to the approximate solution of important concrete problems arising in engineering, economics and operations research.

Moderne Techniken bauen mehr denn je auf der Mathematik auf. So durchdringen Informationsverarbeitung, Modellierung, Systemanalyse, Stochastik, Simulations- und Optimierungsmethoden alle Bereiche der Naturwissenschaften, Ingenieur- und Wirtschaftswissenschaften. Selbst Sprachwissenschaftler, Psychologen oder Soziologen benötigen heute ein ausreichendes mathematisches Rüstzeug, um in ihrem Beruf bestehen zu können. Andererseits haben Studienanfänger sehr häufig ungenügende mathematische Kenntnisse in der Differential- und Integralrechnung für Funktionen einer Variablen. Zur Schaffung solider mathematischer Grundlagen vermittelt dieses Buch durch eine behutsame Einführung und Veranschaulichung der Begriffe und Methoden eine lebendige Vorstellung des Stoffes und eine saubere Beherrschung der grundlegenden analytischen Techniken, um die verschiedenartigsten Aufgaben zu lösen.

Dieses Buch ist eine Einführung in die mathematische Theorie der Optimierung. Nach einer kurzen Beschreibung der Problemstellung und einer Übersicht über die grundlegenden Typen von Optimierungsaufgaben werden im zweiten Kapitel lineare Optimierungsprobleme behandelt, für die ein vollständiges Lösungsverfahren, der Simplexalgorithmus, zur Verfügung steht. Für die Lösung nichtlinearer Optimierungsaufgaben mit differenzierbaren bzw. konvexen Funktionen werden im dritten Kapitel notwendige und hinreichende Optimimalitätsbedingungen bereitgestellt. Bei der Darstellung des Stoffes wurde darauf geachtet, neue Begriffe und Methoden anhand vieler Beispiele auf anschauliche Art einzuführen. Vorausgesetzt werden einige wenige mathematische Grundkenntnisse, wie sie in jeder einführenden Vorlesung in die Höhere Mathematik vermittelt werden. Jeder Abschnitt schließt mit einer Reihe von Übungsaufgaben. Die ausführlichen Lösungen zu allen Aufgaben werden am Ende des Lehrbuchs gegeben.

Die sichere Beherrschung der für viele ingenieurwissenschaftlich-technische und wirtschaftswissenschaftlich-statistische Anwendungen unverzichtbaren mathematischen Grundlagen aus der Differential- und Integralrechnung (Analysis) einer Variablen erfordert neben dem Besuch von Kursen über "Differential- und Integralrechnung einer Variablen" insbesondere auch die selbständige Bearbeitung einer ausreichenden Anzahl von Beispielen und Übungsaufgaben zu den im "Grundkurs Mathematik" oder anderen einführenden Werken über Analysis einer Variablen behandelten mathematischen Werkzeugen. Ausreichendes Übungsmaterial mit vollständigen Lösungen zum Nachrechnen oder zur Kontrolle eigener Lösungen ist im "Übungsbuch" enthalten. Die Gliederung der Übungsaufgaben richtet sich dabei nach dem bewährten Aufbau der Kurse über Differential- und Integralrechnung einer Variablen (Analysis I).