Numerical Mathematics and Scientific Computation – serie

This book offers a unique pathway to methods of parallel optimization by introducing parallel computing ideas and techniques into both optimization theory, and into some numerical algorithms for large-scale optimization problems. The presentation is based on the recent understanding that rigorous mathematical analysis of algorithms, parallel computing techniques, and "hands-on" experimental work on real-world problems must go hand in hand in order to achieve the greatest advantage from novel parallel computing architectures. The three parts of the book thus bring together relevant theory, careful study of algorithms, and modelling of significant real world problems. The problem domains include: image reconstruction, radiation therapy treatment planning, transportation problems, portfolilo management, and matrix estimation. This text can be used both as a reference for researchers and as a text for advanced graduate courses.

Domain decomposition methods are designed to allow the effective numerical solution of partial differential equations on parallel computer architectures. They comprise a relatively new field of study, but have already found important applications in many branches of physics and engineering. In this book the authors illustrate the basic mathematical concepts behind domain decomposition, looking at a large variety of boundary value problems. Contents include; symmetric elliptic equations; advection-diffusion equations; the elasticity problem; the Stokes problem for incompressible and compressible fluids; the time-harmonic Maxwell equations; parabolic and hyperbolic equations; and suitable couplings of heterogeneous equations.

The finite element method is a numerical method widely used in engineering. Experience shows that unreliable computation can lead to very serious consequences. Hence reliability questions stand more and more at the forefront of engineering and theoretical interests. The present book presents the mathematical theory of the finite element method and focuses on the question of how reliable computed results really are. It addresses among other topics the local behaviour, errors caused by pollution, superconvergence, and optimal meshes. Many computational examples illustrate the importance of the theoretical conclusions for practical computations. Graduate students, lecturers, and researchers in mathematics, engineering, and scientific computation will benefit from the clear structure of the book, and will find this a very useful reference.

This book is an introduction to the mathematical analysis of p- and hp-finite elements applied to elliptic problems in solid and fluid mechanics, and is suitable for graduate students and researchers who have had some prior exposure to finite element methods (FEM). In the last decade the p-, hp-, and spectral element methods have emerged as efficient and robust approximation methods for several classes of problems in this area. The aim of this book is therefore to establish the exponential convergence of such methods for problems with the piecewise analytic solutions which typically arise in engineering. It looks at the variational formulation of boundary value problems with particular emphasis on the regularity of the solution. The books then studies the p- and hp- convergence of FEM in one and two dimensions, supplying complete proofs. Also covered are hp-FEM for saddle point problems and the techniques for establishing the discrete infsup condition. Finally, hp-FEM in solid mechanics and the issue of locking is addressed in the context of these methods.

In recent years, stylized forms of the Boltzmann equation, now going by the name of "Lattice Boltzmann equation" (LBE), have emerged, which relinquish most mathematical complexities of the true Boltzmann equation without sacrificing physical fidelity in the description of many situations involving complex fluid motion. This book provides the first detailed survey of LBE theory and its major applications to date. Accessible to a broad audience of scientists dealing with complex system dynamics, the book also portrays future developments in allied areas of science (material science, biology etc.) where fluid motion plays a distinguished role.

Toeplitz and Toeplitz-related systems arise in a variety of applications in mathematics and engineering, especially in signal and image processing. This book deals primarily with iterative methods for solving Toeplitz and Toeplitz-related linear systems, discussing both the algorithms and their convergence theories. A basic knowledge of real analysis, elementary numerical analysis and linear algebra is assumed.The first part of the book (chapters one and two) gives a brief review of some terms and results in linear algebra and the conjugate gradient method, which are important topics for handling the mathematics later on in the book. The second part of the book (chapters three to seven) presents the theory of using iterative methods for solving Toeplitz and Toeplitz-related systems. The third part of the book (chapters eight to twelve) presents recent results from applying the use of iterative methods in different fields of applications, such as partial differential equations, signal and image processing, integral equations and queuing networks. These chapters provide research and application-oriented readers with a thorough understanding of using iterative methods, enabling them not only to apply these methods to the problems discussed but also to derive and analyse new methods for other types of problems and applications.

This book is concerned with mathematical and numerical methods for compressible flow. It aims to provide the reader with a sufficiently detailed and extensive, mathematically precise, but comprehensible guide, through a wide spectrum of mathematical and computational methods used in Computational Fluid Dynamics (CFD) for the numerical simulation of compressible flow. Up-to-date techniques applied in the numerical solution of inviscid as well as viscous compressible flow on unstructured meshes are explained, thus allowing the simulation of complex three-dimensional technically relevant problems. Among some of the methods addressed are finite volume methods using approximate Riemann solvers, finite element techniques, such as the streamline diffusion and the discontinuous Galerkin methods, and combined finite volume - finite element schemes. The book gives a complex insight into the numerics of compressible flow, covering the development of numerical schemes and their theoretical mathematical analysis, their verification on test problems and use in solving practical engineering problems. The book will be helpful to specialists coming into contact with CFD - pure and applied mathematicians, aerodynamists, engineers, physicists and natural scientists. It will also be suitable for advanced undergraduate, graduate and postgraduate students of mathematics and technical sciences.

The main purpose of the book is to introduce the readers to the numerical integration of the Cauchy problem for delay differential equations (DDEs). Peculiarities and differences that DDEs exhibit with respect to ordinary differential equations are preliminarily outlined by numerous examples illustrating some unexpected, and often surprising, behaviours of the analytical and numerical solutions. The effect of various kinds of delays on the regularity of the solution is described and some essential existence and uniqueness results are reported. The book is centered on the use of Runge-Kutta methods continuously extended by polynomial interpolation, includes a brief review of the various approaches existing in the literature, and develops an exhaustive error and well-posedness analysis for the general classes of one-step and multistep methods. The book presents a comprehensive development of continuous extensions of Runge-Kutta methods which are of interest also in the numerical treatment of more general problems such as dense output, discontinuous equations, etc. Some deeper insight into convergence and superconvergence of continuous Runge-Kutta methods is carried out for DDEs with various kinds of delays. The stepsize control mechanism is also developed on a firm mathematical basis relying on the discrete and continuous local error estimates. Classical results and a unconventional analysis of "stability with respect to forcing term" is reviewed for ordinary differential equations in view of the subsequent numerical stability analysis. Moreover, an exhaustive description of stability domains for some test DDEs is carried out and the corresponding stability requirements for the numerical methods are assessed and investigated. Alternative approaches, based on suitable formulation of DEs as partial differential equations and subsequent semidiscretization are briefly described and compared with the classical approach. A list of available codes is provided, and illustrative examples, pseudo-codes and numerical experiments are included throughout the book.Series Editors: G. H. Golub (Stanford University)C. Schwab (ETH Zurich)W. A. Light (University of Leicester)E. Süli (University of Oxford)Recent developments in the field of numerical analysis have radically changed the nature of the subject. Firstly, the increasing power and availability of computer workstations has allowed the widespread feasibility of complex numerical computations, and the demands of mathematical modelling are expanding at a corresponding rate. In addition to this, the mathematical theory of numerical mathematics itself is growing in sophistication, and numerical analysis now generates research into relatively abstract mathematics.Oxford University Press has had an established series Monographs in Numerical Analysis, including Wilkinson's celebrated treatise The Algebraic Eigenvalue Problem. In the face of the developments in the field this has been relaunched as the Numerical Mathematics and Scientific Computation series. As its name suggests, the series will now aim to cover the broad subject area concerned with theoretical and computational aspects of modern numerical mathematics.

This is the first book on constructive methods for, and applications of orthogonal polynomials, and the first available collection of relevant Matlab codes. The book begins with a concise introduction to the theory of polynomials orthogonal on the real line (or a portion thereof), relative to a positive measure of integration. Topics which are particularly relevant to computation are emphasized. The second chapter develops computational methods for generating the coefficients in the basic three-term recurrence relation. The methods are of two kinds: moment-based methods and discretization methods. The former are provided with a detailed sensitivity analysis. Other topics addressed concern Cauchy integrals of orthogonal polynomials and their computation, a new discussion of modification algorithms, and the generation of Sobolev orthogonal polynomials. The final chapter deals with selected applications: the numerical evaluation of integrals, especially by Gauss-type quadrature methods, polynomial least squares approximation, moment-preserving spline approximation, and the summation of slowly convergent series. Detailed historic and bibliographic notes are appended to each chapter. The book will be of interest not only to mathematicians and numerical analysts, but also to a wide clientele of scientists and engineers who perceive a need for applying orthogonal polynomials.

The subject of sparse matrices has its root in such diverse fields as management science, power systems analysis, surveying, circuit theory, and structural analysis. Efficient use of sparsity is a key to solving large problems in many fields. This second edition is a complete rewrite of the first edition published 30 years ago. Much has changed since that time. Problems have grown greatly in size and complexity; nearly all examples in the first edition were of order less than 5,000 in the first edition, and are often more than a million in the second edition. Computer architectures are now much more complex, requiring new ways of adapting algorithms to parallel environments with memory hierarchies. Because the area is such an important one to all of computational science and engineering, a huge amount of research has been done in the last 30 years, some of it by the authors themselves. This new research is integrated into the text with a clear explanation of the underlying mathematics and algorithms.New research that is described includes new techniques for scaling and error control, new orderings, new combinatorial techniques for partitioning both symmetric and unsymmetric problems, and a detailed description of the multifrontal approach to solving systems that was pioneered by the research of the authors and colleagues. This includes a discussion of techniques for exploiting parallel architectures and new work for indefinite and unsymmetric systems.

Since the middle of the last century, computing power has increased sufficiently that the direct numerical approximation of Maxwell's equations is now an increasingly important tool in science and engineering. Parallel to the increasing use of numerical methods in computational electromagnetism there has also been considerable progress in the mathematical understanding of the properties of Maxwell's equations relevant to numerical analysis. The aim of this book is to provide an up to date and sound theoretical foundation for finite element methods in computational electromagnetism. The emphasis is on finite element methods for scattering problems that involve the solution of Maxwell's equations on infinite domains. Suitable variational formulations are developed and justified mathematically. An error analysis of edge finite element methods that are particularly well suited to Maxwell's equations is the main focus of the book. The methods are justified for Lipschitz polyhedral domains that can cause strong singularities in the solution. The book finishes with a short introduction to inverse problems in electromagnetism.

The origins of wavelets go back to the beginning of the last century and wavelet methods are by now a well-known tool in image processing (jpeg2000). These functions have, however, been used successfully in other areas, such as elliptic partial differential equations, which can be used to model many processes in science and engineering. This book, based on the author's course and accessible to those with basic knowledge of analysis and numerical mathematics, gives an introduction to wavelet methods in general and then describes their application for the numerical solution of elliptic partial differential equations. Recently developed adaptive methods are also covered and each scheme is complemented with numerical results, exercises, and corresponding software tools.

Authored by three leading experts in the development of the language, this is a complete and authoritative description of the two languages (Fortran 95 and Fortran 2003). It is intended for new and existing users of Fortran, and for all those involved in scientific and numerical computing. It is suitable as textbook for teaching and, with its extensive index, as a handy reference for practitioners.

Intersecting two large research areas - numerical analysis and applied probability/queuing theory - this book is a self-contained introduction to the numerical solution of structured Markov chains, which have a wide applicability in queuing theory and stochastic modeling and include M/G/1 and GI/M/1-type Markov chain, quasi-birth-death processes, non-skip free queues and tree-like stochastic processes. Written for applied probabilists and numerical analysts, but accessible to engineers and scientists working on telecommunications and evaluation of computer systems performances, it provides a systematic treatment of the theory and algorithms for important families of structured Markov chains and a thorough overview of the current literature. The book, consisting of nine Chapters, is presented in three parts. Part 1 covers a basic description of the fundamental concepts related to Markov chains, a systematic treatment of the structure matrix tools, including finite Toeplitz matrices, displacement operators, FFT, and the infinite block Toeplitz matrices, their relationship with matrix power series and the fundamental problems of solving matrix equations and computing canonical factorizations. Part 2 deals with the description and analysis of structure Markov chains and includes M/G/1, quasi-birth-death processes, non-skip-free queues and tree-like processes. Part 3 covers solution algorithms where new convergence and applicability results are proved. Each chapter ends with bibliographic notes for further reading, and the book ends with an appendix collecting the main general concepts and results used in the book, a list of the main annotations and algorithms used in the book, and an extensive index.

Based on the author's lecture notes and research, this well-illustrated and comprehensive text is one of the first to provide an introduction to image registration with particular emphasis on numerical methods in medical imaging. Ideal for researchers in industry and academia, it is also a suitable study guide for graduate mathematicians, computer scientists, engineers, medical physicists, and radiologists.Image registration is utilised whenever information obtained from different viewpoints needs to be combined or compared and unwanted distortion needs to be eliminated. For example, CCTV images, ultrasound images, brain scan images, fingerprint and retinal scanning.Modersitzki's book provides a systematic introduction to the theoretical, practical, and numerical aspects of image registration, with special emphasis on medical applications. Various techniques are described, discussed and compared using numerous illustrations.The text starts with an introduction to the mathematical principles and the motivating example of the Human Neuroscanning Project whose aim is to build an atlas of the human brain through reconstructing essential information out of deformed images of sections of a prepared brain.The introduction is followed by coverage of parametric image registrations such as landmark based, principal axes based, and optimal affine linear registration. Basic distance measures like sum of squared differences, correlation, and mutual information are also discussed. The next section is devoted to state-of-the-art non-parametric image registrations where general variational based framework for image registration is presented and used to describe and compare well-known and new image registration techniques. Finally, efficient numerical schemes for the underlying partial differential equations are presented and discussed.This text treats the basic mathematical principles, including aspects from approximation theory, image processing, numerics, partial differential equations, and statistics, with a strong focus on numerical methods in image processing. Providing a systematic and general framework for image registration, the book not only presents state-of-the-art concepts but also summarises and classifies the numerous techniques to be found in the literature.

Spectral methods have long been popular in direct and large eddy simulation of turbulent flows, but their use in areas with complex-geometry computational domains has historically been much more limited. More recently the need to find accurate solutions to the viscous flow equations around complex configurations has led to the development of high-order discretisation procedures on unstructured meshes, which are also recognised as more efficient for solution of time-dependent oscillatory solutions over long time periods. Here Karniadakis and Sherwin present a much-updated and expanded version of their successful first edition covering the recent and significant progress in multi-domain spectral methods at both the fundamental and application level. Containing over 50% new material, including discontinuous Galerkin methods, non-tensorial nodal spectral element methods in simplex domains, and stabilisation and filtering techniques, this text aims to introduce a wider audience to the use of spectral/hp element methods with particular emphasis on their application to unstructured meshes. It provides a detailed explanation of the key concepts underlying the methods along with practical examples of their derivation and application, and is aimed at students, academics and practitioners in computational fluid mechanics, applied and numerical mathematics, computational mechanics, aerospace and mechanical engineering and climate/ocean modelling.

This is a new paperback edition of probably the most important and widely read text on numerical analysis. It is the distillation of what the author learnt about the computation of matrix eigenvalues by dint of trying all methods known to him on computers he helped to make.He was establishing the special nature of these computations as he wrote, and this, along with his emphasis on understanding rather than proving theorems, resulted in an informal and very readable work which became an almost instant classic.

This book presents an up-to-date exposition of the current `state of the art' of numerical methods for solving ordinary differential equations in a parallel computing environment. Although the main focus is on problems of initial value type, consideration will also be given to boundary value problems and partial differential equations. Furthermore, because linear algebra is an important component of the solution of differential equations, a complete chapter is devoted to the parallel solution of linear systems of equations. In addition to presenting an overview of parallel computing in general, two chapters are devoted to a summary of existing sequential differential equation methods. The parallel techniques discussed include parallelism across the method, parallelism across the step, parallelism across the system, and dynamic iteration. The book concludes with a chapter on the behaviour of a parallel code based on waveform relaxation.This comprehensive book is unique in its content and provides a balance between theoretical and practical issues by providing general frameworks in which to study parallel methods.

This book is mainly concerned with finite element methods for time-dependent partial differential equations when the grids are allowed to move in time, but also describes grid generation techniques which include grid adjustment. The mechanism for grid movement derives from a generalization of the residual minimization technique which is familiar from the Galerkin finite element method. The book brings together most of the work done over the last decade or so which has been stimulated by Miller's original idea, and discusses the interrelationships between the techniques of the method and the established ideas of the method of characteristics, Hamilton's equations, the Legendre transformation, and grid equidistribution. The book highlights the issues involved and should provide the reader with a clear view of the current state of the subject and prompt further research.

The subject of geomathematics focuses on the interpretation and classification of data from geoscientific and satellite sources, reducing information to a comprehensible form and allowing the testing of concepts. Sphere oriented mathematics plays an important part in this study and this book provides the necessary foundation for graduate students and researchers interested in any of the diverse topics of constructive approximation in this area.This book bridges the existing gap between monographs on special functions of mathematical physics and constructive approximation in Euclidean spaces. The primary objective is to provide readers with an understanding of aspects of approximation by spherical harmonics, such as spherical splines and wavelets, as well as indicating future directions of research. Scalar, vectorial, and tensorial methods are each considered in turn. The concentration on spherical splines and wavelets allows a double simplification; not only is the number of independent variables reduced resulting in a lower dimensional problem, but also radial basis function techniques become applicable. When applied to geomathematics this leads to new structures and methods by which sophisticated measurements and observations can be handled more efficiently, thus reducing time and costs.

Inverse eigenvalue problems arise in a remarkable variety of applications and associated with any inverse eigenvalue problem are two fundamental questions--the theoretical issue of solvability and the practical issue of computability. Both questions are difficult and challenging. In this text, the authors discuss the fundamental questions, some known results, many applications, mathematical properties, a variety of numerical techniques, as well as several open problems.This is the first book in the authoritative Numerical Mathematics and Scientific Computation series to cover numerical linear algebra, a broad area of numerical analysis. Authored by two world-renowned researchers, the book is aimed at graduates and researchers in applied mathematics, engineering and computer science and makes an ideal graduate text.

This comprehensive text focuses on mathematical and numerical techniques for the simulation of magnetohydrodynamic phenomena, with an emphasis laid on the magnetohydrodynamics of liquid metals, and on a prototypical industrial application. Aimed at research mathematicians, engineers, and physicists, as well as those working in industry, and starting from a good understanding of the physics at play, the approach is a highly mathematical one, based on the rigorous analysis of the equations at hand, and a solid numerical analysis to found the simulations. At each stage of the exposition, examples of numerical simulations are provided, first on academic test cases to illustrate the approach, next on benchmarks well documented in the professional literature, and finally, whenever possible, on real industrial cases.

The mathematical theory of Krylov subspace methods with a focus on solving systems of linear algebraic equations is given a detailed treatment in this principles-based book. Starting from the idea of projections, Krylov subspace methods are characterised by their orthogonality and minimisation properties. Projections onto highly nonlinear Krylov subspaces can be linked with the underlying problem of moments, and therefore Krylov subspace methods can be viewed as matching moments model

Fortran marches on, remaining one of the principal programming languages used in high-performance scientific, numerical, and engineering computing. A series of significant revisions to the standard versions of the language have progressively enhanced its capabilities, and the latest standard - Fortran 2018 - includes many additions and improvements.This edition of Modern Fortran Explained expands on the last. Given the release of updated versions of Fortran compilers, the separate descriptions of Fortran 2003 and Fortran 2008 have been incorporated into the main text, which thereby becomes a unified description of the full Fortran 2008 version of the language. This clearer standard has allowed many deficiencies and irregularities in the earlier language versions to be resolved.Four new chapters describe the additional features of Fortran 2018, with its enhancements to coarrays for parallel programming, interoperability with C, IEEE arithmetic, and various other improvements.Written by leading experts in the field, two of whom have actively contributed to Fortran 2018, this is a complete and authoritative description of Fortran in its latest form. It is intended for new and existing users of the language, and for all those involved in scientific and numerical computing. It is suitable as a textbook for teaching and, with its index, as a handy reference for practitioners.

Fortran marches on, remaining one of the principal programming languages used in high-performance scientific, numerical, and engineering computing. A series of significant revisions to the standard versions of the language have progressively enhanced its capabilities, and the latest standard - Fortran 2018 - includes many additions and improvements.This edition of Modern Fortran Explained expands on the last. Given the release of updated versions of Fortran compilers, the separate descriptions of Fortran 2003 and Fortran 2008 have been incorporated into the main text, which thereby becomes a unified description of the full Fortran 2008 version of the language. This clearer standard has allowed many deficiencies and irregularities in the earlier language versions to be resolved.Four new chapters describe the additional features of Fortran 2018, with its enhancements to coarrays for parallel programming, interoperability with C, IEEE arithmetic, and various other improvements.Written by leading experts in the field, two of whom have actively contributed to Fortran 2018, this is a complete and authoritative description of Fortran in its latest form. It is intended for new and existing users of the language, and for all those involved in scientific and numerical computing. It is suitable as a textbook for teaching and, with its index, as a handy reference for practitioners.

This text, based on the author's teaching at École Polytechnique, introduces the reader to the world of mathematical modelling and numerical simulation. Covering the finite difference method; variational formulation of elliptic problems; Sobolev spaces; elliptical problems; the finite element method; Eigenvalue problems; evolution problems; optimality conditions and algorithms and methods of operational research, and including a several exercises throughout, this is an ideal text for advanced undergraduate students and graduates in applied mathematics, engineering, computer science, and the physical sciences.

This text, based on the author's teaching at École Polytechnique, introduces the reader to the world of mathematical modelling and numerical simulation. Covering the finite difference method; variational formulation of elliptic problems; Sobolev spaces; elliptical problems; the finite element method; Eigenvalue problems; evolution problems; optimality conditions and algorithms and methods of operational research, and including a several exercises throughout, this is an ideal text for advanced undergraduate students and graduates in applied mathematics, engineering, computer science, and the physical sciences.

The fields of computational fluid dynamics (CFD) and optimal shape design (OSD) have received considerable attention in the recent past, and are of practical importance for many engineering applications.This new edition of Applied Shape Optimization for Fluids deals with shape optimization problems for fluids, with the equations needed for their understanding (Euler and Navier Strokes, but also those for microfluids) and with the numerical simulation of these problems. It presents the state of the art in shape optimization for an extended range of applications involving fluid flows. Automatic differentiation, approximate gradients, unstructured mesh adaptation, multi-model configurations, and time-dependent problems are introduced, and their implementation into the industrial environments of aerospace and automobile equipment industry explained and illustrated. With the increases in the power of computers in industry since the first edition, methods which were previously unfeasible have begun giving results, namely evolutionary algorithms, topological optimization methods, and level set algortihms. In this edition, these methods have been treated in separate chapters, but the book remains primarily one on differential shape optimization.This book is essential reading for engineers interested in the implementation and solution of optimization problems using commercial packages or in-house solvers and graduates and researchers in applied mathematics, aerospace, or mechanical engineering, fluid dynamics, and CFD. More generally, anyone needing to understand and solve design problems or looking for new exciting areas for research and development in this area will find this book useful, especially in applying the methodology to practical problems.

Nonlinear elliptic problems play an increasingly important role in mathematics, science and engineering, creating an exciting interplay between the subjects. This is the first and only book to prove in a systematic and unifying way, stability, convergence and computing results for the different numerical methods for nonlinear elliptic problems. The proofs use linearization, compact perturbation of the coercive principal parts, or monotone operator techniques, and approximation theory. Examples are given for linear to fully nonlinear problems (highest derivatives occur nonlinearly) and for the most important space discretization methods: conforming and nonconforming finite element, discontinuous Galerkin, finite difference, wavelet (and, in a volume to follow, spectral and meshfree) methods. A number of specific long open problems are solved here: numerical methods for fully nonlinear elliptic problems, wavelet and meshfree methods for nonlinear problems, and more general nonlinear boundary conditions. We apply it to all these problems and methods, in particular to eigenvalues, monotone operators, quadrature approximations, and Newton methods. Adaptivity is discussed for finite element and wavelet methods.The book has been written for graduate students and scientists who want to study and to numerically analyze nonlinear elliptic differential equations in Mathematics, Science and Engineering. It can be used as material for graduate courses or advanced seminars.