Thomas Kneib - Böcker

Several recent advances in smoothing and semiparametric regression are presented in this book from a unifying, Bayesian perspective. Simulation-based full Bayesian Markov chain Monte Carlo (MCMC) inference, as well as empirical Bayes procedures closely related to penalized likelihood estimation and mixed models, are considered here. Throughout, the focus is on semiparametric regression and smoothing based on basis expansions of unknown functions and effects in combination with smoothness priors for the basis coefficients.Beginning with a review of basic methods for smoothing and mixed models, longitudinal data, spatial data and event history data are treated in separate chapters. Worked examples from various fields such as forestry, development economics, medicine and marketing are used to illustrate the statistical methods covered in this book. Most of these examples have been analysed using implementations in the Bayesian software, BayesX, and some with R Codes. These, as well as some of the data sets, are made publicly available on the website accompanying this book.

An emerging field in statistics, distributional regression facilitates the modelling of the complete conditional distribution, rather than just the mean. This book introduces generalized additive models for location, scale and shape (GAMLSS) - one of the most important classes of distributional regression. Taking a broad perspective, the authors consider penalized likelihood inference, Bayesian inference, and boosting as potential ways of estimating models and illustrate their usage in complex applications. Written by the international team who developed GAMLSS, the text's focus on practical questions and problems sets it apart. Case studies demonstrate how researchers in statistics and other data-rich disciplines can use the model in their work, exploring examples ranging from fetal ultrasounds to social media performance metrics. The R code and data sets for the case studies are available on the book's companion website, allowing for replication and further study.

In dieser Einführung werden erstmals klassische Regressionsansätze und moderne nicht- und semiparametrische Methoden in einer integrierten, einheitlichen und anwendungsorientierten Form beschrieben. Die Darstellung wendet sich an Studierende der Statistik in Wahl- und Hauptfach sowie an empirisch-statistisch und interdisziplinär arbeitende Wissenschaftler und Praktiker, zum Beispiel in Wirtschafts- und Sozialwissenschaften, Bioinformatik, Biostatistik, Ökonometrie, Epidemiologie. Die praktische Anwendung der vorgestellten Konzepte und Methoden wird anhand ausführlich vorgestellter Fallstudien demonstriert, um dem Leser die Analyse eigener Fragestellungen zu ermöglichen.

Thus, the book primarily targets an audience that includes students, teachers and practitioners in social, economic, and life sciences, as well as students and teachers in statistics programs, and mathematicians and computer scientists with interests in statistical modeling and data analysis.

Now in its second edition, this textbook provides an applied and unified introduction to parametric, nonparametric and semiparametric regression that closes the gap between theory and application. The most important models and methods in regression are presented on a solid formal basis, and their appropriate application is shown through numerous examples and case studies. The most important definitions and statements are concisely summarized in boxes, and the underlying data sets and code are available online on the book’s dedicated website. Availability of (user-friendly) software has been a major criterion for the methods selected and presented.The chapters address the classical linear model and its extensions, generalized linear models, categorical regression models, mixed models, nonparametric regression, structured additive regression, quantile regression and distributional regression models. Two appendices describe the required matrix algebra, as well as elements of probability calculus and statistical inference.In this substantially revised and updated new edition the overview on regression models has been extended, and now includes the relation between regression models and machine learning, additional details on statistical inference in structured additive regression models have been added and a completely reworked chapter augments the presentation of quantile regression with a comprehensive introduction to distributional regression models. Regularization approaches are now more extensively discussed in most chapters of the book.The book primarily targets an audience that includes students, teachers and practitioners in social, economic, and life sciences, as well as students and teachers in statistics programs, and mathematicians and computer scientists with interests in statistical modeling and data analysis. It is written at an intermediate mathematical level and assumes only knowledge of basic probability, calculus, matrix algebra and statistics.

Now in its second edition, this textbook provides an applied and unified introduction to parametric, nonparametric and semiparametric regression that closes the gap between theory and application. The most important models and methods in regression are presented on a solid formal basis, and their appropriate application is shown through numerous examples and case studies. The most important definitions and statements are concisely summarized in boxes, and the underlying data sets and code are available online on the book’s dedicated website. Availability of (user-friendly) software has been a major criterion for the methods selected and presented.The chapters address the classical linear model and its extensions, generalized linear models, categorical regression models, mixed models, nonparametric regression, structured additive regression, quantile regression and distributional regression models. Two appendices describe the required matrix algebra, as well as elements of probability calculus and statistical inference.In this substantially revised and updated new edition the overview on regression models has been extended, and now includes the relation between regression models and machine learning, additional details on statistical inference in structured additive regression models have been added and a completely reworked chapter augments the presentation of quantile regression with a comprehensive introduction to distributional regression models. Regularization approaches are now more extensively discussed in most chapters of the book.The book primarily targets an audience that includes students, teachers and practitioners in social, economic, and life sciences, as well as students and teachers in statistics programs, and mathematicians and computer scientists with interests in statistical modeling and data analysis. It is written at an intermediate mathematical level and assumes only knowledge of basic probability, calculus, matrix algebra and statistics.

Thecollectedcontributionscontainedwithinthisbookhavebeenwrittenbyfriends andcolleaguestoacknowledgeLudwigFahrmeir'swidespreadandimportantimpact onStatisticsasascience,whilecelebratinghis65thBirthday. Asayoungstudent,LudwigstartedhiscareerasaMathematician,buthequickly turnedintoarisingandshiningstarwithintheGermanandinternationalStatistics community. HesoonobtainedbothhisPhDandhisHabilitationattheTechnical UniversityofMunich. AfterashortperiodasavisitingprofessorattheUniversity ofDortmund,hereturnedtohishomelandBavariaandwasappointedFullProfessor ofStatisticsattheUniversityofRegensburg,attheageof32. Someyearslater,hemovedtothecapitalofBavariaandbecameProfessoratthe DepartmentofStatisticsattheUniversityofMunich. Hisappointmenthadsigni?cant impactontheDepartmentsince,soonafterhisarrival,Ludwigstartedaninitiative toestablishacollaborativeresearchcenteronthe"StatisticalAnalysisofDiscrete Structures. "Afterasuccessfulapplicationforinitialfunding,furtherfundingwas extendedseveraltimes,untiltheresearchcenterreachedthemaximumperiodfor fundingin2006. Duringthecompleteduration,Ludwigservedasaspeakerofthe researchcenterand-tociteoneofthe?nalreferees-"manageditinaneasyand ef?cientwayandcontributedseveralimportantresults." Duringthelastfortyyears,Ludwig'sworkhashadtremendousimpactontheS- tisticscommunity. Hewasamongthe?rstresearcherstorecognizetheimportance ofgeneralizedlinearmodelsandcontributedinaseriesofpaperstothetheoretical backgroundofthatmodelclass. Hisinterestinstatisticalmodellingledtothe- ganizationofaworkshopon"StatisticalModellingandGeneralizedLinearModels (GLIM)"inMunichin1992andculminatedinthehighlycitedmonographon"M- tivariateStatisticalModellingBasedonGeneralizedLinearModels"thatsawtwo printingsandremainstobeakeyreferenceonappliedstatisticalmodellingutilizing generalizedlinearmodels. Ludwigalsohadgreatin?uenceonthecreationofthe StatisticalModellingSociety,andiscurrentlyontheadvisoryboardofthecor- spondingjournalon"StatisticalModelling. "Boththesocietyandjournalemerged outoftheearlyGLIMworkshopsandproceedings. v vi Foreword Ofcourse,Ludwig'sworkisde?nitelynotrestrictedtogeneralizedlinearmodels but-onthecontrary-spansawiderangeofmodernStatistics. Heco-authoredor co-editedseveralmonographs,e. g. onMultivariateStatistics,StochasticProcesses, MeasurementofCreditRisks,aswellaspopulartextbooksonRegressionandan IntroductiontoStatistics.Hisrecentresearchcontributionsaremostlyconcentrated insemiparametricregressionandspatialstatisticswithinaBayesianframework. When?rstcirculatingtheideaofaFestschriftforthecelebrationofLudwig's 65thbirthday,allpotentialcontributorswereextremelypositive,manyimmediately agreeingtocontribute. ThesereactionsatesttoLudwig'shighpersonalandp- fessionalappreciationinthestatisticalcommunity. Thefarreachingandvarietyof subjectscoveredwithinthesecontributionsalsorepresentsLudwig'sbroadinterest andimpactinmanybranchesofmodernStatistics. BotheditorsofthisFestschriftwereluckyenoughtoworkwithLudwigatseveral occasionsandinparticularearlyintheircareersasPhDstudentsandPostDocs. His personalandprofessionalmentorshipandhisstrongcommitmentmadehimaperfect supervisorandhispatient,con?dentandencouragingworkingstylewillalwaysbe rememberedbyallofhisstudentsandcolleagues. Ludwigalwaysprovidedafriendly workingenvironmentthatmadeitapleasureandanhonortobeapartofhisworking group. WeareproudtobeabletosaythatLudwigismuchmorethanacolleague butturnedintoafriendforbothofus.OldenburgandMunich,January2010 ThomasKneib,GerhardTutz Acknowledgements Theeditorswouldliketoexpresstheirgratitudeto * allauthorsofthisvolumefortheiragreementtocontributeandtheireasyco- erationatseveralstagesofputtingtogetherthe?nalversionoftheFestschrift. * JohannaBrandt,JanGertheiss,AndreasGroll,FelixHeinzl,SebastianPetry,Jan UlbrichtandStephanieRubenbauerfortheirinvaluablecontributionsinproof- A readingandcorrectionofthepapers,aswellasinsolvingseveralLTX-related E problems. *swidespreadandimportantimpact onStatisticsasascience,whilecelebratinghis65thBirthday. Asayoungstudent,LudwigstartedhiscareerasaMathematician,buthequickly turnedintoarisingandshiningstarwithintheGermanandinternationalStatistics community. HesoonobtainedbothhisPhDandhisHabilitationattheTechnical UniversityofMunich. AfterashortperiodasavisitingprofessorattheUniversity ofDortmund,hereturnedtohishomelandBavariaandwasappointedFullProfessor ofStatisticsattheUniversityofRegensburg,attheageof32. Someyearslater,hemovedtothecapitalofBavariaandbecameProfessoratthe DepartmentofStatisticsattheUniversityofMunich. Hisappointmenthadsigni?cant impactontheDepartmentsince,soonafterhisarrival,Ludwigstartedaninitiative toestablishacollaborativeresearchcenteronthe"StatisticalAnalysisofDiscrete Structures."Afterasuccessfulapplicationforinitialfunding,furtherfundingwas extendedseveraltimes,untiltheresearchcenterreachedthemaximumperiodfor fundingin2006. Duringthecompleteduration,Ludwigservedasaspeakerofthe researchcenterand-tociteoneofthe?nalreferees-"manageditinaneasyand ef?cientwayandcontributedseveralimportantresults. " Duringthelastfortyyears,Ludwig'sworkhashadtremendousimpactontheS- tisticscommunity. Hewasamongthe?rstresearcherstorecognizetheimportance ofgeneralizedlinearmodelsandcontributedinaseriesofpaperstothetheoretical backgroundofthatmodelclass. Hisinterestinstatisticalmodellingledtothe- ganizationofaworkshopon"StatisticalModellingandGeneralizedLinearModels (GLIM)"inMunichin1992andculminatedinthehighlycitedmonographon"M- tivariateStatisticalModellingBasedonGeneralizedLinearModels"thatsawtwo printingsandremainstobeakeyreferenceonappliedstatisticalmodellingutilizing generalizedlinearmodels. Ludwigalsohadgreatin?uenceonthecreationofthe StatisticalModellingSociety,andiscurrentlyontheadvisoryboardofthecor- spondingjournalon"StatisticalModelling. "Boththesocietyandjournalemerged outoftheearlyGLIMworkshopsandproceedings. v vi Foreword Ofcourse,Ludwig'sworkisde?nitelynotrestrictedtogeneralizedlinearmodels but-onthecontrary-spansawiderangeofmodernStatistics.Heco-authoredor co-editedseveralmonographs,e. g. onMultivariateStatistics,StochasticProcesses, MeasurementofCreditRisks,aswellaspopulartextbooksonRegressionandan IntroductiontoStatistics. Hisrecentresearchcontributionsaremostlyconcentrated insemiparametricregressionandspatialstatisticswithinaBayesianframework. When?rstcirculatingtheideaofaFestschriftforthecelebrationofLudwig's 65thbirthday,allpotentialcontributorswereextremelypositive,manyimmediately agreeingtocontribute. ThesereactionsatesttoLudwig'shighpersonalandp- fessionalappreciationinthestatisticalcommunity. Thefarreachingandvarietyof subjectscoveredwithinthesecontributionsalsorepresentsLudwig'sbroadinterest andimpactinmanybranchesofmodernStatistics. BotheditorsofthisFestschriftwereluckyenoughtoworkwithLudwigatseveral occasionsandinparticularearlyintheircareersasPhDstudentsandPostDocs. His personalandprofessionalmentorshipandhisstrongcommitmentmadehimaperfect supervisorandhispatient,con?dentandencouragingworkingstylewillalwaysbe rememberedbyallofhisstudentsandcolleagues. Ludwigalwaysprovidedafriendly workingenvironmentthatmadeitapleasureandanhonortobeapartofhisworking group.WeareproudtobeabletosaythatLudwigismuchmorethanacolleague butturnedintoafriendforbothofus. OldenburgandMunich,January2010 ThomasKneib,GerhardTutz Acknowledgements Theeditorswouldliketoexpresstheirgratitudeto * allauthorsofthisvolumefortheiragreementtocontributeandtheireasyco- erationatseveralstagesofputtingtogetherthe?nalversionoftheFestschrift. * JohannaBrandt,JanGertheiss,AndreasGroll,FelixHeinzl,SebastianPetry,Jan UlbrichtandStephanieRubenbauerfortheirinvaluablecontributionsinproof- A readingandcorrectionofthepapers,aswellasinsolvingseveralLTX-related E problems. * theSpringerVerlagforagreeingtopublishthisFestschriftandinparticularNils- PeterThomas,AliceBlanck and FrankHolzwarthfor the smooth collabo- tion in preparing th emanuscript. vii Contents ListofContributors...xix TheSmoothComplexLogarithmandQuasi-PeriodicModels ...1 PaulH. C. Eilers 1 Foreword...1 2 Introduction...1 3 DataandModels...2 3. 1 TheBasicModel...3 3. 2 SplinesandPenalties...3 3. 3 StartingValues...7 3. 4 SimpleTrendCorrectionandPriorTransformation...8 3. 5 AComplexSignal...8 3. 6 Non-normalDataandCascadedLinks...10 3. 7 AddingHarmonics...11 4 MoretoExplore...12 5 Discussion...15 References...17 P-splineVaryingCoef?cientModelsforComplexData...19 BrianD. Marx 1 Introduction ...19 2 "LargeScale"VCM,withoutBack?tting...22 3 NotationandSnapshotofaSmoothingTool:B-splines...24 3. 1 GeneralKnotPlacement...25 3. 2 SmoothingtheKTBData...25 4 UsingB-splinesforVaryingCoef?cientModels...26 5 P-splineSnapshot:Equally-SpacedKnots&Penalization...28 5. 1 P-splinesforAdditiveVCMs...30 5. 2 StandardErrorBands...30 6 OptimallyTuningP-splines ...31 7 MoreKTBResults...33 8 ExtendingP-VCMintotheGeneralizedLinearModel...33 9 Two-dimensionalVaryingCoef?cientModels...36 ix x Contents 9. 1 Mechanicsof2D-VCMthroughExample ...37 9. 2 VCMsandPenaltiesasArrays...39 9. 3 Ef?cientComputationUsingArrayRegression...40 10 DiscussionTowardMoreComplexVCMs...41 References...42 PenalizedSplines,MixedModelsandBayesianIdeas...45 .. GoranKauermann 1 Introduction...45 2 NotationandPenalizedSplinesasLinearMixedModels...46 3 Classi?cationwithMixedModels...48 4 VariableSelectionwithSimplePriors...50 4. 1 MarginalAkaikeInformationCriterion...50 4. 2 ComparisoninLinearModels...