Springer Texts in Statistics – serie

An Introduction to Statistical Learning provides an accessible overview of the field of statistical learning, an essential toolset for making sense of the vast and complex data sets that have emerged in fields ranging from biology to finance to marketing to astrophysics in the past twenty years. This book presents some of the most important modeling and prediction techniques, along with relevant applications. Topics include linear regression, classification, resampling methods, shrinkage approaches, tree-based methods, support vector machines, clustering, deep learning, survival analysis, multiple testing, and more. Color graphics and real-world examples are used to illustrate the methods presented. Since the goal of this textbook is to facilitate the use of these statistical learning techniques by practitioners in science, industry, and other fields, each chapter contains a tutorial on implementing the analyses and methods presented in R, an extremely popular open source statistical software platform.Two of the authors co-wrote The Elements of Statistical Learning (Hastie, Tibshirani and Friedman, 2nd edition 2009), a popular reference book for statistics and machine learning researchers. An Introduction to Statistical Learning covers many of the same topics, but at a level accessible to a much broader audience. This book is targeted at statisticians and non-statisticians alike who wish to use cutting-edge statistical learning techniques to analyze their data. The text assumes only a previous course in linear regression and no knowledge of matrix algebra.This Second Edition features new chapters on deep learning, survival analysis, and multiple testing, as well as expanded treatments of naïve Bayes, generalized linear models, Bayesian additive regression trees, and matrix completion. R code has been updated throughout to ensure compatibility.

An Introduction to Statistical Learning provides an accessible overview of the field of statistical learning, an essential toolset for making sense of the vast and complex data sets that have emerged in fields ranging from biology to finance, marketing, and  astrophysics in the past twenty years. This book presents some of the most important modeling and prediction techniques, along with relevant applications. Topics include linear regression, classification, resampling methods, shrinkage approaches, tree-based methods, support vector machines, clustering, deep learning, survival analysis, multiple testing, and more. Color graphics and real-world examples are used to illustrate the methods presented. This book is targeted at statisticians and non-statisticians alike, who wish to use cutting-edge statistical learning techniques to analyze their data. Four of the authors co-wrote An Introduction to Statistical Learning, With Applications in R(ISLR), which has become a mainstay of undergraduate and graduate classrooms worldwide, as well as an important reference book for data scientists. One of the keys to its success was that each chapter contains a tutorial on implementing the analyses and methods presented in the R scientific computing environment. However, in recent years Python has become a popular language for data science, and there has been increasing demand for a Python-based alternative to ISLR. Hence, this book (ISLP) covers the same materials as ISLR but with labs implemented in Python. These labs will be useful both for Python novices, as well as experienced users.

This is a somewhat extended and modified translation of the third edition of the text, first published in 1969. The Swedish edition has been used for many years at the Royal Institute of Technology in Stockholm, and at the School of Engineering at Link6ping University. It is also used in elementary courses for students of mathematics and science. The book is not intended for students interested only in theory, nor is it suited for those seeking only statistical recipes. Indeed, it is designed to be intermediate between these extremes. I have given much thought to the question of dividing the space, in an appropriate way, between mathematical arguments and practical applications. Mathematical niceties have been left aside entirely, and many results are obtained by analogy. The students I have in mind should have three ingredients in their course: elementary probability theory with applications, statistical theory with applications, and something about the planning of practical investiga­ tions. When pouring these three ingredients into the soup, I have tried to draw upon my experience as a university teacher and on my earlier years as an industrial statistician. The programme may sound bold, and the reader should not expect too much from this book. Today, probability, statistics and the planning of investigations cover vast areas and, in 356 pages, only the most basic problems can be discussed. If the reader gains a good understanding of probabilistic and statistical reasoning, the main purpose of the book has been fulfilled.

The purpose of this book is to provide the reader with a solid background and understanding of the basic results and methods in probability theory before entering into more advanced courses (in probability and/or statistics). The presentation is fairly thorough and detailed with many solved examples. Several examples are solved with di erent methods in order to illustrate their di erent levels of sophistication, their pros, and their cons. The motivation for this style of exposition is that experience has proved that the hard part in courses of this kind usually is the application of the results and methods; to know how, when, and where to apply what; and then, technically, to solve a given problem once one knows how to proceed. Exercises are spread out along the way, and every chapter ends with a large selection of problems. Chapters 1 through 6 focus on some central areas of what might be called pure probability theory: multivariate random variables, conditioning, tra- forms, order variables, the multivariate normal distribution, and convergence.

Many current texts in the area are just cookbooks and, as a result, students do not know why they perform the methods they are taught, or why the methods work. The strength of this book is that it readdresses these shortcomings; by using examples, often from real life and using real data, the authors show how the fundamentals of probabilistic and statistical theories arise intuitively. A Modern Introduction to Probability and Statistics has numerous quick exercises to give direct feedback to students. In addition there are over 350 exercises, half of which have answers, of which half have full solutions. A website gives access to the data files used in the text, and, for instructors, the remaining solutions. The only pre-requisite is a first course in calculus; the text covers standard statistics and probability material, and develops beyond traditional parametric models to the Poisson process, and on to modern methods such as the bootstrap.

This 5th edition of this popular graduate textbook presents a balanced and comprehensive treatment of both time and frequency domain methods with accompanying theory. It includes numerous examples using nontrivial data illustrate solutions to problems such as discovering natural and anthropogenic climate change, evaluating pain perception experiments using functional magnetic resonance imaging, and monitoring a nuclear test ban treaty. The R package ‘astsa’ has had major updates and the text will reflect those updates. In general, the graphics have been improved. New topics include random number generation, modeling and fitting predator-prey interactions, more emphasis on structural models, testing for linearity, discussion of EM algorithm is more extensive, Bayesian analysis of state space models and MCMC is more extensive (including new scripts in astsa), particle methods are introduced, stochastic volatility coverage is expanded, changepoint detection is introduced (new topic).The book is designed as a textbook for graduate level students in the physical, biological, and social sciences and as a graduate level text in statistics. Some parts may also serve as an undergraduate introductory course. Theory and methodology are separated to allow presentations on different levels. In addition to coverage of classical methods of time series regression, ARIMA models, spectral analysis and state-space models, the text includes modern developments including categorical time series analysis, multivariate spectral methods, long memory series, nonlinear models, resampling techniques, GARCH models, ARMAX models, stochastic volatility, and Markov chain Monte Carlo integration methods.This edition includes R code for each numerical example.

An Introduction to Statistical Learning provides an accessible overview of the field of statistical learning, an essential toolset for making sense of the vast and complex data sets that have emerged in fields ranging from biology to finance to marketing to astrophysics in the past twenty years. This book presents some of the most important modeling and prediction techniques, along with relevant applications. Topics include linear regression, classification, resampling methods, shrinkage approaches, tree-based methods, support vector machines, clustering, deep learning, survival analysis, multiple testing, and more. Color graphics and real-world examples are used to illustrate the methods presented. Since the goal of this textbook is to facilitate the use of these statistical learning techniques by practitioners in science, industry, and other fields, each chapter contains a tutorial on implementing the analyses and methods presented in R, an extremely popular open source statistical software platform.Two of the authors co-wrote The Elements of Statistical Learning (Hastie, Tibshirani and Friedman, 2nd edition 2009), a popular reference book for statistics and machine learning researchers. An Introduction to Statistical Learning covers many of the same topics, but at a level accessible to a much broader audience. This book is targeted at statisticians and non-statisticians alike who wish to use cutting-edge statistical learning techniques to analyze their data. The text assumes only a previous course in linear regression and no knowledge of matrix algebra.This Second Edition features new chapters on deep learning, survival analysis, and multiple testing, as well as expanded treatments of naïve Bayes, generalized linear models, Bayesian additive regression trees, and matrix completion. R code has been updated throughout to ensure compatibility.

Categorical data arise often in many fields, including biometrics, economics, management, manufacturing, marketing, psychology, and sociology. This book provides an introduction to the analysis of such data. The coverage is broad, using the loglinear Poisson regression model and logistic binomial regression models as the primary engines for methodology. Topics covered include count regression models, such as Poisson, negative binomial, zero-inflated, and zero-truncated models; loglinear models for two-dimensional and multidimensional contingency tables, including for square tables and tables with ordered categories; and regression models for two-category (binary) and multiple-category target variables, such as logistic and proportional odds models.All methods are illustrated with analyses of real data examples, many from recent subject area journal articles. These analyses are highlighted in the text, and are more detailed than is typical, providing discussion of the context and background of the problem, model checking, and scientific implications. More than 200 exercises are provided, many also based on recent subject area literature. Data sets and computer code are available at a web site devoted to the text. Adopters of this book may request a solutions manual from: textbook@springer-ny.com. From the reviews:"Jeff Simonoff's book is at the top of the heap of categorical data analysis textbooks...The examples are superb. Student reactions in a class I taught from this text were uniformly positive, particularly because of the examples and exercises. Additional materials related to the book, particularly code for S-Plus, SAS, and R, useful for analysis of examples, can be found at the author's Web site at New York University. I liked this book for this reason, and recommend it to you for pedagogical purposes." (Stanley Wasserman, The American Statistician, August 2006, Vol. 60, No. 3)"The book has various noteworthy features. The examples used are from a variety of topics, including medicine, economics, sports, mining, weather, as well as social aspects like needle-exchange programs. The examples motivate the theory and also illustrate nuances of data analytical procedures. The book also incorporates several newer methods for analyzing categorical data, including zero-inflated Poisson models, robust analysis of binomial and poisson models, sandwich estimators, multinomial smoothing, ordinal agreement tables…this is definitely a good reference book for any researcher working with categorical data." Technometrics, May 2004"This guide provides a practical approach to the appropriate analysis of categorical data and would be a suitable purchase for individuals with varying levels of statistical understanding." Paediatric and Perinatal Epidemiology, 2004, 18"This book gives a fresh approach to the topic of categorical data analysis. The presentation of the statistical methods exploits the connection to regression modeling with a focus on practical features rather than formal theory...There is much to learn from this book. Aside from the ordinary materials such as association diagrams, Mantel-Haenszel estimators, or overdispersion, the reader will also find some less-often presented but interesting and stimulating topics...[T]his is an excellent book, giving an up-to-date introduction to the wide field of analyzing categorical data." Biometrics, September 2004"...It is of great help to data analysts, practitioners and researchers who deal with categorical data and need to get a necessary insight into the methods of analysis as well as practical guidelines for solving problems." International Journal of General Systems, August 2004"The author has succeeded in writing a useful and readable textbook combining most of general theory and practice of count data." Kwantitatieve Methoden"The book especially stresses how to analyze and interpret data...In fact, the highly detailed multi-page descriptions of analysis and interpretation make the book stand out." Mathematical Geology, February 2005"Overall, this is a competent and detailed text that I would recommend to anyone dealing with the analysis of categorical data." Journal of the Royal Statistical Society"This important work allows for clear analogies between the well-known linear models for Gaussian data and categorical data problems. … Jeffrey Simonoff’s Analyzing Categorical Data provides an introduction to many of the important ideas and methods for understanding counted data and tables of counts. … Some readers will find Simonoff’s style very much to their liking due to reliance on extended real data examples to illuminate ideas. … I think the extensive examples will appeal to most students." (Sanford Weisberg, SIAM Review, Vol. 47 (4), 2005)"It is clear that the focus of Simonoff’s book is different from other books on categorical data analysis. … As an introductory textbook, the book is comprehensive enough since all basic topics in categorical data analysis are discussed. … I think Simonoff’s book is a valuable addition to the literature because it discusses important models for counts … ." (Jeroen K. Vermunt, Statistics in Medicine, Vol. 24, 2005)"The author based this book on his notes for a class with a very diverse pool of students. The material is presented in such a way that a very heterogeneous group of students could grasp it. All methods are illustrated with analyses of real data examples. The author provides a detailed discussion of the context and background of the problem. … The book is very interesting and can be warmly recommended to people working with categorical data." (EMS - European Mathematical Society Newsletter, December,2004)"Categorical data arise often in many fields … . This book provides an introduction to the analysis of such data. … All methods are illustrated with analyses of real data examples, many from recent subject-area journal articles. These analyses are highlighted in the text and are more detailed than is typical … . More than 200 exercises are provided, including many based on recent subject-area literature. Data sets and computer code are available at a Web site devoted to this text." (T. Postelnicu, Zentralblatt MATH, Vol. 1028, 2003)"This book grew out of notes prepared by the author for classes in categorical data analysis. The presentation is fresh and compelling to read. Regression ideas are used to motivate the modelling presented. The book focuses on applying methods to real problems; many of these will be novel to readers of statistics texts … . All chapters end with a section providing references to books or articles for the inquiring reader." (C.M. O’Brien, Short Book Reviews, Vol. 23 (3), 2003)

This book focuses on tools and techniques for building regression models using real-world data and assessing their validity. A key theme throughout the book is that it makes sense to base inferences or conclusions only on valid models. Plots are shown to be an important tool for both building regression models and assessing their validity. We shall see that deciding what to plot and how each plot should be interpreted will be a major challenge. In order to overcome this challenge we shall need to understand the mathematical properties of the fitted regression models and associated diagnostic procedures. As such this will be an area of focus throughout the book. In particular, we shall carefully study the properties of resi- als in order to understand when patterns in residual plots provide direct information about model misspecification and when they do not. The regression output and plots that appear throughout the book have been gen- ated using R. The output from R that appears in this book has been edited in minor ways. On the book web site you will find the R code used in each example in the text.

This textbook emphasizes the applications of statistics and probability to finance.  Students are assumed to have had a prior course in statistics, but no background in finance or economics. The basics of probability and statistics are reviewed and more advanced topics in statistics, such as regression, ARMA and GARCH models, the bootstrap, and nonparametric regression using splines, are introduced as needed. The book covers the classical methods of finance such as portfolio theory, CAPM, and the Black-Scholes formula, and it introduces the somewhat newer area of behavioral finance. Applications and use of MATLAB and SAS software are stressed.The book will serve as a text in courses aimed at advanced undergraduates and masters students in statistics, engineering, and applied mathematics as well as quantitatively oriented MBA students. Those in the finance industry wishing to know more statistics could also use it for self-study.

Monte Carlo statistical methods, particularly those based on Markov chains, are now an essential component of the standard set of techniques used by statisticians. This new edition has been revised towards a coherent and flowing coverage of these simulation techniques, with incorporation of the most recent developments in the field. In particular, the introductory coverage of random variable generation has been totally revised, with many concepts being unified through a fundamental theorem of simulation There are five completely new chapters that cover Monte Carlo control, reversible jump, slice sampling, sequential Monte Carlo, and perfect sampling. There is a more in-depth coverage of Gibbs sampling, which is now contained in three consecutive chapters. The development of Gibbs sampling starts with slice sampling and its connection with the fundamental theorem of simulation, and builds up to two-stage Gibbs sampling and its theoretical properties. A third chapter covers the multi-stage Gibbs sampler and its variety of applications. Lastly, chapters from the previous edition have been revised towards easier access, with the examples getting more detailed coverage. This textbook is intended for a second year graduate course, but will also be useful to someone who either wants to apply simulation techniques for the resolution of practical problems or wishes to grasp the fundamental principles behind those methods. The authors do not assume familiarity with Monte Carlo techniques (such as random variable generation), with computer programming, or with any Markov chain theory (the necessary concepts are developed in Chapter 6). A solutions manual, which covers approximately 40% of the problems, is available for instructors who require the book for a course. Christian P. Robert is Professor of Statistics in the Applied Mathematics Department at Université Paris Dauphine, France. He is also Head of the Statistics Laboratoryat the Center for Research in Economics and Statistics (CREST) of the National Institute for Statistics and Economic Studies (INSEE) in Paris, and Adjunct Professor at Ecole Polytechnique. He has written three other books and won the 2004 DeGroot Prize for The Bayesian Choice, Second Edition, Springer 2001. He also edited Discretization and MCMC Convergence Assessment, Springer 1998. He has served as associate editor for the Annals of Statistics, Statistical Science and the Journal of the American Statistical Association. He is a fellow of the Institute of Mathematical Statistics, and a winner of the Young Statistician Award of the Société de Statistique de Paris in 1995. George Casella is Distinguished Professor and Chair, Department of Statistics, University of Florida. He has served as the Theory and Methods Editor of the Journal of the American Statistical Association and Executive Editor of Statistical Science. He has authored three other textbooks: Statistical Inference, Second Edition, 2001, with Roger L. Berger; Theory of Point Estimation, 1998, with Erich Lehmann; and Variance Components, 1992, with Shayle R. Searle and Charles E. McCulloch. He is a fellow of the Institute of Mathematical Statistics and the American Statistical Association, and an elected fellow of the International Statistical Institute.

There are many books on various aspects of nonparametric inference such as density estimation, nonparametric regression, bootstrapping, and wavelets methods. But it is hard to ?nd all these topics covered in one place. The goal of this text is to provide readers with a single book where they can ?nd a brief account of many of the modern topics in nonparametric inference. The book is aimed at master’s-level or Ph. D. -level statistics and computer science students. It is also suitable for researchersin statistics, machine lea- ing and data mining who want to get up to speed quickly on modern n- parametric methods. My goal is to quickly acquaint the reader with the basic concepts in many areas rather than tackling any one topic in great detail. In the interest of covering a wide range of topics, while keeping the book short, I have opted to omit most proofs. Bibliographic remarks point the reader to references that contain further details. Of course, I have had to choose topics to include andto omit,the title notwithstanding. For the mostpart,I decided to omit topics that are too big to cover in one chapter. For example, I do not cover classi?cation or nonparametric Bayesian inference. The book developed from my lecture notes for a half-semester (20 hours) course populated mainly by master’s-level students. For Ph. D.

This book arose out of two graduate courses that the authors have taught duringthepastseveralyears;the?rstonebeingonmeasuretheoryfollowed by the second one on advanced probability theory. The traditional approach to a ?rst course in measure theory, such as in Royden (1988), is to teach the Lebesgue measure on the real line, then the p di?erentation theorems of Lebesgue, L -spaces on R, and do general m- sure at the end of the course with one main application to the construction of product measures. This approach does have the pedagogic advantage of seeing one concrete case ?rst before going to the general one. But this also has the disadvantage in making many students’ perspective on m- sure theory somewhat narrow. It leads them to think only in terms of the Lebesgue measure on the real line and to believe that measure theory is intimately tied to the topology of the real line. As students of statistics, probability, physics, engineering, economics, and biology know very well, there are mass distributions that are typically nonuniform, and hence it is useful to gain a general perspective. This book attempts to provide that general perspective right from the beginning. The opening chapter gives an informal introduction to measure and integration theory. It shows that the notions of ?-algebra of sets and countable additivity of a set function are dictated by certain very na- ral approximation procedures from practical applications and that they are not just some abstract ideas.

Though there are many recent additions to graduate-level introductory books on Bayesian analysis, none has quite our blend of theory, methods, and ap­ plications. We believe a beginning graduate student taking a Bayesian course or just trying to find out what it means to be a Bayesian ought to have some familiarity with all three aspects. More specialization can come later. Each of us has taught a course like this at Indian Statistical Institute or Purdue. In fact, at least partly, the book grew out of those courses. We would also like to refer to the review (Ghosh and Samanta (2002b)) that first made us think of writing a book. The book contains somewhat more material than can be covered in a single semester. We have done this intentionally, so that an instructor has some choice as to what to cover as well as which of the three aspects to emphasize. Such a choice is essential for the instructor. The topics include several results or methods that have not appeared in a graduate text before. In fact, the book can be used also as a second course in Bayesian analysis if the instructor supplies more details. Chapter 1 provides a quick review of classical statistical inference. Some knowledge of this is assumed when we compare different paradigms. Following this, an introduction to Bayesian inference is given in Chapter 2 emphasizing the need for the Bayesian approach to statistics.

Longitudinal data are ubiquitous across Medicine, Public Health, Public Policy, Psychology, Political Science, Biology, Sociology and Education, yet many longitudinal data sets remain improperly analyzed. This book teaches the art and statistical science of modern longitudinal data analysis. The author emphasizes specifying, understanding, and interpreting longitudinal data models. He inspects the longitudinal data graphically, analyzes the time trend and covariates, models the covariance matrix, and then draws conclusions.Covariance models covered include random effects, autoregressive, autoregressive moving average, antedependence, factor analytic, and completely unstructured models among others. Longer expositions explore: an introduction to and critique of simple non-longitudinal analyses of longitudinal data, missing data concepts, diagnostics, and simultaneous modeling of two longitudinal variables. Applications and issues for random effects models cover estimation, shrinkage, clustered data, models for binary and count data and residuals and residual plots. Shorter sections include a general discussion of how computational algorithms work, handling transformed data, and basic design issues.This book requires a solid regression course as background and is particularly intended for the final year of a Biostatistics or Statistics Masters degree curriculum. The mathematical prerequisite is generally low, mainly assuming familiarity with regression analysis in matrix form. Doctoral students in Biostatistics or Statistics, applied researchers and quantitative doctoral students in disciplines such as Medicine, Public Health, Public Policy, Psychology, Political Science, Biology, Sociology and Education will find this book invaluable. The book has many figures and tables illustrating longitudinal data and numerous homework problems. The associated web site contains many longitudinal data sets, examples of computer code, and labs to re-enforce thematerial. From the reviews: "...This book is extremely well presented and it has been written in a style that makes its reading really pleasant and enjoyable...I highly recommend Modeling Longitudinal Data as a good reference book for anyone interested in looking into the art and statistical science of modern longitudinal data analysis." Journal of Applied Statistics, December 2005"The book is clearly written and well presented. The author's accumulated experience in presenting the material comes over. On balance, this is one of the books which anyone about to teach a practical course in longitudinal data analysis should consider adopting as the course text." Short Book Reviews of the ISI, June 2006"...Modeling Longitudinal Data is a welcome addition to the vast literature on longitudinal data analysis. The book requires little in terms of prerequisites but offers a great deal." Zhigang Zhang for the Journal of the American Statistical Association, December 2006"Overall, Robert Weiss's book can be used as an excellent textbook for a first master-level course in longitudinal data analysis in a statistics or biostatistics program, or as a self-study book for applied researchers interested in this area...The style is very clear, concepts are explained in an engaging way and amply illustrated, and the chapters on covariate selection and modeling the variance-covariance matrix are definite assets." Ralitza Gueorgueiva for Biostatistics, September 2006

Taken literally, the title "All of Statistics" is an exaggeration. But in spirit, the title is apt, as the book does cover a much broader range of topics than a typical introductory book on mathematical statistics. This book is for people who want to learn probability and statistics quickly. It is suitable for graduate or advanced undergraduate students in computer science, mathematics, statistics, and related disciplines. The book includes modern topics like non-parametric curve estimation, bootstrapping, and classification, topics that are usually relegated to follow-up courses. The reader is presumed to know calculus and a little linear algebra. No previous knowledge of probability and statistics is required. Statistics, data mining, and machine learning are all concerned with collecting and analysing data.

Now available in paperback. This is a text comprising the major theorems of probability theory and the measure theoretical foundations of the subject. The main topics treated are independence, interchangeability,and martingales; particular emphasis is placed upon stopping times, both as tools in proving theorems and as objects of interest themselves. No prior knowledge of measure theory is assumed and a unique feature of the book is the combined presentation of measure and probability. It is easily adapted for graduate students familar with measure theory as indicated by the guidelines in the preface. Special features include: A comprehensive treatment of the law of the iterated logarithm; the Marcinklewicz-Zygmund inequality, its extension to martingales and applications thereof;  development and applications of the second moment analogue of Wald's equation; limit theorems for martingale arrays, the central limit theorem for the interchangeable and martingale cases, moment convergence in the central limit theorem; complete discussion, including central limit theorem, of the random casting of r balls into n cells; recent martingale inequalities; Cram r-L vy theore and factor-closed families of distributions. This edition includes a section dealing with U-statistic, adds additional theorems and examples, and includes simpler versions of some proofs.

Bayesian statistics is a very active research area with new theoretical results and applications. This book will serve as an introduction to the area.

Time Series Analysis With Applications in R, Second Edition, presents an accessible approach to understanding time series models and their applications. Although the emphasis is on time domain ARIMA models and their analysis, the new edition devotes two chapters to the frequency domain and three to time series regression models, models for heteroscedasticity, and threshold models. All of the ideas and methods are illustrated with both real and simulated data sets.A unique feature of this edition is its integration with the R computing environment. The tables and graphical displays are accompanied by the R commands used to produce them. An extensive R package, TSA, which contains many new or revised R functions and all of the data used in the book, accompanies the written text. Script files of R commands for each chapter are available for download. There is also an extensive appendix in the book that leads the reader through the use of R commands and the new R package to carryout the analyses.

Statistical design is one of the fundamentals of our subject, being at the core of the growth of statistics during the previous century. Design played a key role in agricultural statistics and set down principles of good practic, principles that still apply today. Statistical design is all about understanding where the variance comes from, and making sure that is where the replication is. Indeed, it is probably correct to say that these principles are even more important today.

This book developed out of my year-long course on asymptotic theory at Purdue University. To some extent, the topics coincide with what I cover in that course. There are already a number of well-known books on asy- totics. This book is quite different. It covers more topics in one source than areavailableinanyothersinglebookonasymptotictheory. Numeroustopics covered in this book are available in the literature in a scattered manner, and they are brought together under one umbrella in this book. Asymptotic theory is a central unifying theme in probability and statistics. My main goal in writing this book is to give its readers a feel for the incredible scope and reach of asymptotics. I have tried to write this book in a way that is accessible and to make the reader appreciate the beauty of theory and the insights that only theory can provide. Essentially every theorem in the book comes with at least one reference, preceding or following the statement of the theorem. In addition, I have p- vided a separate theorem-by-theorem reference as an entry on its own in the front of the book to make it extremely convenient for the reader to ?nd a proof that was not provided in the text. Also particularly worth mentioning is a collection of nearly 300 practically useful inequalities that I have c- lected together from numerous sources. This is appended at the very end of the book.

The idea of writing this bookarosein 2000when the ?rst author wasassigned to teach the required course STATS 240 (Statistical Methods in Finance) in the new M. S. program in ?nancial mathematics at Stanford, which is an interdisciplinary program that aims to provide a master’s-level education in applied mathematics, statistics, computing, ?nance, and economics. Students in the programhad di?erent backgroundsin statistics. Some had only taken a basic course in statistical inference, while others had taken a broad spectrum of M. S. - and Ph. D. -level statistics courses. On the other hand, all of them had already taken required core courses in investment theory and derivative pricing, and STATS 240 was supposed to link the theory and pricing formulas to real-world data and pricing or investment strategies. Besides students in theprogram,thecoursealso attractedmanystudentsfromother departments in the university, further increasing the heterogeneity of students, as many of them had a strong background in mathematical and statistical modeling from the mathematical, physical, and engineering sciences but no previous experience in ?nance. To address the diversity in background but common strong interest in the subject and in a potential career as a “quant” in the ?nancialindustry,thecoursematerialwascarefullychosennotonlytopresent basic statistical methods of importance to quantitative ?nance but also to summarize domain knowledge in ?nance and show how it can be combined with statistical modeling in ?nancial analysis and decision making. The course material evolved over the years, especially after the second author helped as the head TA during the years 2004 and 2005.

Remarkable advances in computation and data storage and the ready availability of huge data sets have been the keys to the growth of the new disciplines of data mining and machine learning, while the enormous success of the Human Genome Project has opened up the field of bioinformatics. These exciting developments, which led to the introduction of many innovative statistical tools for high-dimensional data analysis, are described here in detail. The author takes a broad perspective; for the first time in a book on multivariate analysis, nonlinear methods are discussed in detail as well as linear methods. Techniques covered range from traditional multivariate methods, such as multiple regression, principal components, canonical variates, linear discriminant analysis, factor analysis, clustering, multidimensional scaling, and correspondence analysis, to the newer methods of density estimation, projection pursuit, neural networks, multivariate reduced-rank regression, nonlinear manifold learning, bagging, boosting, random forests, independent component analysis, support vector machines, and classification and regression trees. Another unique feature of this book is the discussion of database management systems.This book is appropriate for advanced undergraduate students, graduate students, and researchers in statistics, computer science, artificial intelligence, psychology, cognitive sciences, business, medicine, bioinformatics, and engineering. Familiarity with multivariable calculus, linear algebra, and probability and statistics is required. The book presents a carefully-integrated mixture of theory and applications, and of classical and modern multivariate statistical techniques, including Bayesian methods. There are over 60 interesting data sets used as examples in the book, over 200 exercises, and many color illustrations and photographs.

This undergraduate statistical quality assurance textbook clearly shows with real projects, cases and data sets how statistical quality control tools are used in practice.  Among the topics covered is a practical evaluation of measurement effectiveness for both continuous and discrete data.  Gauge Reproducibility and Repeatability methodology (including confidence intervals for Repeatability, Reproducibility and the Gauge Capability Ratio) is thoroughly developed. Process capability indices and corresponding confidence intervals are also explained.  In addition to process monitoring techniques, experimental design and analysis for process improvement are carefully presented. Factorial and Fractional Factorial arrangements of treatments and Response Surface methods are covered.Integrated throughout the book are rich sets of examples and problems that help readers gain a better understanding of where and how to apply statistical quality control tools.  These large and realistic problem sets in combination with the streamlined approach of the text and extensive supporting material facilitate reader understanding.Second Edition ImprovementsExtensive coverage of measurement quality evaluation (in addition to ANOVA Gauge R&R methodologies)New end-of-section exercises and revised-end-of-chapter exercisesTwo full sets of slides, one with audio to assist student preparation outside-of-class and another appropriate for professors’ lecturesSubstantial supporting materialSupporting MaterialSeven R programs that support variables and attributes control chart construction and analyses, Gauge R&R methods, analyses of Fractional Factorial studies,  Propagation of Error analyses and Response Surface analysesDocumentation for the R programsExcel data files associated with theend-of-chapter problem sets, most from real engineering settings

* A self-contained introduction to probability, exchangeability and Bayes' rule provides a theoretical understanding of the applied material. * Numerous examples with R-code that can be run "as-is" allow the reader to perform the data analyses themselves. * The development of Monte Carlo and Markov chain Monte Carlo methods in the context of data analysis examples provides motivation for these computational methods.

Intended as the text for a sequence of advanced courses, this book covers major topics in theoretical statistics in a concise and rigorous fashion. The discussion assumes a background in advanced calculus, linear algebra, probability, and some analysis and topology. Measure theory is used, but the notation and basic results needed are presented in an initial chapter on probability, so prior knowledge of these topics is not essential.The presentation is designed to expose students to as many of the central ideas and topics in the discipline as possible, balancing various approaches to inference as well as exact, numerical, and large sample methods. Moving beyond more standard material, the book includes chapters introducing bootstrap methods, nonparametric regression, equivariant estimation, empirical Bayes, and sequential design and analysis.The book has a rich collection of exercises. Several of them illustrate how the theory developed in the book may be used in various applications. Solutions to many of the exercises are included in an appendix.

This book is a text at the introductory graduate level, for use in the one­ semester or two-quarter probability course for first-year graduate students that seems ubiquitous in departments of statistics, biostatistics, mathemat­ ical sciences, applied mathematics and mathematics. While it is accessi­ ble to advanced ("mathematically mature") undergraduates, it could also serve, with supplementation, for a course on measure-theoretic probability. Students who master this text should be able to read the "hard" books on probability with relative ease, and to proceed to further study in statistics or stochastic processes. This is a book to teach from. It is not encyclopredic, and may not be suitable for all reference purposes. Pascal once apologized to a correspondent for having written a long letter, saying that he hadn't the time to write a short one. I have tried to write a short book, which is quite deliberately incomplete, globally and locally. Many topics, including at least one of everyone's favorites, are omitted, among them, infinite divisibility, interchangeability, large devia­ tions, ergodic theory and the Markov property. These can be supplied at the discretion and taste of instructors and students, or to suit particular interests.

During the last two decades, structural equation modeling (SEM) has emerged as a powerful multivariate data analysis tool in social science research settings, especially in the fields of sociology, psychology, and education. Although its roots can be traced back to the first half of this century, when Spearman (1904) developed factor analysis and Wright (1934) introduced path analysis, it was not until the 1970s that the works by Karl Joreskog and his associates (e. g. , Joreskog, 1977; Joreskog and Van Thillo, 1973) began to make general SEM techniques accessible to the social and behavioral science research communities. Today, with the development and increasing avail­ ability of SEM computer programs, SEM has become a well-established and respected data analysis method, incorporating many of the traditional analysis techniques as special cases. State-of-the-art SEM software packages such as LISREL (Joreskog and Sorbom, 1993a,b) and EQS (Bentler, 1993; Bentler and Wu, 1993) handle a variety of ordinary least squares regression designs as well as complex structural equation models involving variables with arbitrary distributions. Unfortunately, many students and researchers hesitate to use SEM methods, perhaps due to the somewhat complex underlying statistical repre­ sentation and theory. In my opinion, social science students and researchers can benefit greatly from acquiring knowledge and skills in SEM since the methods-applied appropriately-can provide a bridge between the theo­ retical and empirical aspects of behavioral research.

This textbook is ideal for an undergraduate introduction to probability, with a calculus prerequisite. It is based on a course that the author has taught many times at Berkeley. The text's overall style is informal, but all results are stated precisely, and most are proved. Understanding is developed through intuitive explanations and examples. Graphs, diagrams, and geometrical ideals motivate results that might otherwise look likely purely formal manipulations.