Computer Simulation Validation

Prof. Dr. Dr. Claus Beisbart is Professor for Philosophy of Science (Extraordinarius) in the Institute for Philosophy at the University of Bern, Switzerland.Prof. Dr. Nicole J. Saam is Professor for Sociology (Chair) in the Institute of Sociology at Friedrich-Alexander University Erlangen-Nürnberg, Germany.

• Introduction.- Part I:  Foundations – Basic Conceptions in Simulation Model Validation.- What Is Validation of Computer Simulations?.- Simulation Accuracy, Uncertainty, and Predictive Capability.- Verification and Validation Principles from a Systems Perspective.- Errors and Uncertainties.- Part II: Foundations – Validation as a Scientific Method: Philosophical Frameworks for Thinking about Validation.- Invalidation of Models and Fitness-for-purpose.- Simulation Validation from a Bayesian Perspective.- Validation of Computer Simulations from a Kuhnian Perspective.- Understanding Simulation Validation.- Part III: Methodology – Preparatory Steps.- Assessing the Credibility of Conceptual Models.- The Foundations of Verification in Modeling and Simulation.- The Method of Manufactured Solutions for Code Verification.- Validation Metrics: A Case for Pattern-based Methods.- Analyzing Output from Stochastic Computer Simulations.- Part IV: Methodology – Points of Reference and Related Techniques.- The Use of Experimental Data in Simulation Model Validation.- How to Use and Derive Stylized Facts for Validating Simulation Models.- The Users’ Judgements.- Validation Benchmarks and Related Metrics.- Part V: Methodology – Mathematical Frameworks and Related Techniques.- Testing Simulation Models Using Frequentist Statistics.- Validation Using Bayesian Methods.- Imprecise Probabilities.- Objective Uncertainty Quantification.- Part VI: Methodology – The Organization and Management of Simulation Validation .- Standards for Evaluation of Atmospheric Models in Environmental Meteorology.- The Management of Simulation Validation.- Valid and Reproducible Simulation Studies.- Part VII: Validation at Work – Best Practice-Examples.- Validation of Particle Physics Simulation.- Validation in Fluid Dynamics and Related Fields.- Astrophysical Validation.- Validation in Weather Forecasting.- Validation of Climate Models: An Essential Practice.- Validation of Agent-based Models in Economics and Finance.- Part VIII: Challenges in Simulation Model Validation.- Validation and Equifinality.- Validation and Overparameterization.- Uncertainty Quantification Using Multiple Models.- Challenges to Simulation Validation in the Social Sciences.- Validation and the Uniqueness of Historical Events.- Part IX: Reflecting on Simulation Validation: Philosophical Perspectives and Discussion Points.- What Is a Computer Simulation and What Does This Mean for Simulation Validation?.- How Do the Validations of Simulations and Experiments Compare?.- How Does Holism Challenge the Validation of Computer Simulation?.- What Types of Values Enter Simulation Validation and What are Their Roles?.- Calibration, Validation, and Confirmation.- Should Validation and Verification Be Separated Strictly?.- The Multi-Dimensional Epistemology of Computer Simulations.