Michael R. Berthold – författare

Each passing year bears witness to the development of ever more powerful computers, increasingly fast and cheap storage media, and even higher bandwidth data connections. This makes it easy to believe that we can now – at least in principle – solve any problem we are faced with so long as we only have enough data.Yet this is not the case. Although large databases allow us to retrieve many different single pieces of information and to compute simple aggregations, general patterns and regularities often go undetected. Furthermore, it is exactly these patterns, regularities and trends that are often most valuable.To avoid the danger of “drowning in information, but starving for knowledge” the branch of research known as data analysis has emerged, and a considerable number of methods and software tools have been developed. However, it is not these tools alone but the intelligent application of human intuition in combination with computational power, of sound background knowledge with computer-aided modeling, and of critical reflection with convenient automatic model construction, that results in successful intelligent data analysis projects. Guide to Intelligent Data Analysis provides a hands-on instructional approach to many basic data analysis techniques, and explains how these are used to solve data analysis problems.Topics and features: guides the reader through the process of data analysis, following the interdependent steps of project understanding, data understanding, data preparation, modeling, and deployment and monitoring; equips the reader with the necessary information in order to obtain hands-on experience of the topics under discussion; provides a review of the basics of classical statistics that support and justify many data analysis methods, and a glossary of statistical terms; includes numerous examples using R and KNIME, together with appendices introducing the open source software; integrates illustrations and case-study-style examplesto support pedagogical exposition.This practical and systematic textbook/reference for graduate and advanced undergraduate students is also essential reading for all professionals who face data analysis problems. Moreover, it is a book to be used following one’s exploration of it.Dr. Michael R. Berthold is Nycomed-Professor of Bioinformatics and Information Mining at the University of Konstanz, Germany. Dr. Christian Borgelt is Principal Researcher at the Intelligent Data Analysis and Graphical Models Research Unit of the European Centre for Soft Computing, Spain. Dr. Frank Höppner is Professor of Information Systems at Ostfalia University of Applied Sciences, Germany. Dr. Frank Klawonn is a Professor in the Department of Computer Science and Head of the Data Analysis and Pattern Recognition Laboratory at Ostfalia University of Applied Sciences, Germany. He is also Head of the Bioinformatics and Statistics group at the Helmholtz Centre for Infection Research, Braunschweig, Germany.

Each passing year bears witness to the development of ever more powerful computers, increasingly fast and cheap storage media, and even higher bandwidth data connections. This makes it easy to believe that we can now – at least in principle – solve any problem we are faced with so long as we only have enough data.Yet this is not the case. Although large databases allow us to retrieve many different single pieces of information and to compute simple aggregations, general patterns and regularities often go undetected. Furthermore, it is exactly these patterns, regularities and trends that are often most valuable.To avoid the danger of “drowning in information, but starving for knowledge” the branch of research known as data analysis has emerged, and a considerable number of methods and software tools have been developed. However, it is not these tools alone but the intelligent application of human intuition in combination with computational power, of sound background knowledge with computer-aided modeling, and of critical reflection with convenient automatic model construction, that results in successful intelligent data analysis projects. Guide to Intelligent Data Analysis provides a hands-on instructional approach to many basic data analysis techniques, and explains how these are used to solve data analysis problems.Topics and features: guides the reader through the process of data analysis, following the interdependent steps of project understanding, data understanding, data preparation, modeling, and deployment and monitoring; equips the reader with the necessary information in order to obtain hands-on experience of the topics under discussion; provides a review of the basics of classical statistics that support and justify many data analysis methods, and a glossary of statistical terms; includes numerous examples using R and KNIME, together with appendices introducing the open source software; integrates illustrations and case-study-style examplesto support pedagogical exposition.This practical and systematic textbook/reference for graduate and advanced undergraduate students is also essential reading for all professionals who face data analysis problems. Moreover, it is a book to be used following one’s exploration of it.Dr. Michael R. Berthold is Nycomed-Professor of Bioinformatics and Information Mining at the University of Konstanz, Germany. Dr. Christian Borgelt is Principal Researcher at the Intelligent Data Analysis and Graphical Models Research Unit of the European Centre for Soft Computing, Spain. Dr. Frank Höppner is Professor of Information Systems at Ostfalia University of Applied Sciences, Germany. Dr. Frank Klawonn is a Professor in the Department of Computer Science and Head of the Data Analysis and Pattern Recognition Laboratory at Ostfalia University of Applied Sciences, Germany. He is also Head of the Bioinformatics and Statistics group at the Helmholtz Centre for Infection Research, Braunschweig, Germany.

This open access book constitutes the proceedings of the 18th International Conference on Intelligent Data Analysis, IDA 2020, held in Konstanz, Germany, in April 2020.The 45 full papers presented in this volume were carefully reviewed and selected from 114 submissions. Advancing Intelligent Data Analysis requires novel, potentially game-changing ideas. IDA’s mission is to promote ideas over performance: a solid motivation can be as convincing as exhaustive empirical evaluation.

Making use of data is not anymore a niche project but central to almost every project. With access to massive compute resources and vast amounts of data, it seems at least in principle possible to solve any problem. However, successful data science projects result from the intelligent application of: human intuition in combination with computational power; sound background knowledge with computer-aided modelling; and critical reflection of the obtained insights and results.Substantially updating the previous edition, then entitled Guide to Intelligent Data Analysis, this core textbook continues to provide a hands-on instructional approach to many data science techniques, and explains how these are used to solve real world problems. The work balances the practical aspects of applying and using data science techniques with the theoretical and algorithmic underpinnings from mathematics and statistics. Major updates on techniques and subject coverage (including deep learning) are included.Topics and features: guides the reader through the process of data science, following the interdependent steps of project understanding, data understanding, data blending and transformation, modeling, as well as deployment and monitoring; includes numerous examples using the open source KNIME Analytics Platform, together with an introductory appendix; provides a review of the basics of classical statistics that support and justify many data analysis methods, and a glossary of statistical terms; integrates illustrations and case-study-style examples to support pedagogical exposition; supplies further tools and information at an associated website.This practical and systematic textbook/reference is a “need-to-have” tool for graduate and advanced undergraduate students and essential reading for all professionals who face data science problems. Moreover, it is a “need to use, need to keep” resource following one's exploration of thesubject.

Making use of data is not anymore a niche project but central to almost every project. With access to massive compute resources and vast amounts of data, it seems at least in principle possible to solve any problem. However, successful data science projects result from the intelligent application of: human intuition in combination with computational power; sound background knowledge with computer-aided modelling; and critical reflection of the obtained insights and results.

Substantially updating the previous edition, then entitled Guide to Intelligent Data Analysis, this core textbook continues to provide a hands-on instructional approach to many data science techniques, and explains how these are used to solve real world problems. The work balances the practical aspects of applying and using data science techniques with the theoretical and algorithmic underpinnings from mathematics and statistics. Major updates on techniques and subject coverage (including deep learning) are included.

Topics and features: guides the reader through the process of data science, following the interdependent steps of project understanding, data understanding, data blending and transformation, modeling, as well as deployment and monitoring; includes numerous examples using the open source KNIME Analytics Platform, together with an introductory appendix; provides a review of the basics of classical statistics that support and justify many data analysis methods, and a glossary of statistical terms; integrates illustrations and case-study-style examples to support pedagogical exposition; supplies further tools and information at an associated website.

This practical and systematic textbook/reference is a “need-to-have” tool for graduate and advanced undergraduate students and essential reading for all professionals who face data science problems. Moreover, it is a “need to use, need to keep” resource following one''s exploration of thesubject.

Making use of data is not anymore a niche project but central to almost every project. With access to massive compute resources and vast amounts of data, it seems at least in principle possible to solve any problem. However, successful data science projects result from the intelligent application of: human intuition in combination with computational power; sound background knowledge with computer-aided modelling; and critical reflection of the obtained insights and results.Substantially updating the previous edition, then entitled Guide to Intelligent Data Analysis, this core textbook continues to provide a hands-on instructional approach to many data science techniques, and explains how these are used to solve real world problems. The work balances the practical aspects of applying and using data science techniques with the theoretical and algorithmic underpinnings from mathematics and statistics. Major updates on techniques and subject coverage (including deep learning) are included.Topics and features: guides the reader through the process of data science, following the interdependent steps of project understanding, data understanding, data blending and transformation, modeling, as well as deployment and monitoring; includes numerous examples using the open source KNIME Analytics Platform, together with an introductory appendix; provides a review of the basics of classical statistics that support and justify many data analysis methods, and a glossary of statistical terms; integrates illustrations and case-study-style examples to support pedagogical exposition; supplies further tools and information at an associated website.This practical and systematic textbook/reference is a “need-to-have” tool for graduate and advanced undergraduate students and essential reading for all professionals who face data science problems. Moreover, it is a “need to use, need to keep” resource following one's exploration of thesubject.

The integration of knowledge in the life sciences is continuing apace with ev- increasingimportancebeing placedoncomputer-basedmethodsofdata capture, analysis, and knowledge representation. Today, our many di?erent sciences are providing us with a sea of information: it is the handling of this in?ux that is becoming a key discovery and regulatory question. The solutions to these problems will result in advancements to all of the involved sciences and will be highly in?uential both in the selection of the areas scientists seek to investigate and also on their success. For this to happen, it is crucial to establish an open and lively exchange between computer scientists, biologists, and chemists. To encourage precisely this type of exchange, crossing the borders of the sciences, we organized the 1st Symposium on Computational Life Science in Konstanz, Germany(September 25-27,2005). Themainobjectiveofthesymposiumwasto formbridges,bringingtogetherscientistsfromavarietyofdisciplinestoexchange ideas and research e?orts and to talk about the problems in areas of research that up until now have not been visible at an interdisciplinary level. Our conference program shows that the scienti?c mix worked out very well.From 49 submissions, 21 were selected for presentation at the symposium, c- ering areas ranging from high-level system biology to data analysis related to mass spec traces. As a supplement to the regularconference program,we dedicated one section to papers presentedinthe frameworkof a workshoponDistributed Data Mining in the Life Sciences (LifeDDM), organized by Giuseppe Di Fatta.

We are glad to present the proceedings of the 5th biennial conference in the Intelligent Data Analysis series. The conference took place in Berlin, Germany, August 28–30, 2003. IDA has by now clearly grown up. Started as a small si- symposium of a larger conference in 1995 in Baden-Baden (Germany) it quickly attractedmoreinterest(bothsubmission-andattendance-wise),andmovedfrom London (1997) to Amsterdam (1999), and two years ago to Lisbon. Submission ratesalongwiththeeverimprovingqualityofpapershaveenabledtheor- nizers to assemble increasingly consistent and high-quality programs. This year we were again overwhelmed by yet another record-breaking submission rate of 180 papers. At the Program Chairs meeting we were – based on roughly 500 reviews – in the lucky position of carefully selecting 17 papers for oral and 42 for poster presentation. Poster presenters were given the opportunity to summarize their papers in 3-minute spotlight presentations. The oral, spotlight and poster presentations were then scheduled in a single-track, 2. 5-day conference program, summarized in this book. In accordance with the goal of IDA, “to bring together researchers from diverse disciplines,” we achieved a nice balance of presentations from the more theoreticalside(bothstatisticsandcomputerscience)aswellasmoreapplicati- oriented areas that illustrate how these techniques can be used in practice. Work presented in these proceedings ranges from theoretical contributions dealing, for example, with data cleaning and compression all the way to papers addressing practical problems in the areas of text classi?cation and sales-rate predictions. A considerable number of papers also center around the currently so popular applications in bioinformatics.

This monograph is a detailed introductory presentation of the key classes of intelligent data analysis methods. The twelve coherently written chapters by leading experts provide complete coverage of the core issues. The first half of the book is devoted to the discussion of classical statistical issues, ranging from the basic concepts of probability, through general notions of inference, to advanced multivariate and time series methods, as well as a detailed discussion of the increasingly important Bayesian approaches and Support Vector Machines. The following chapters then concentrate on the area of machine learning and artificial intelligence and provide introductions into the topics of rule induction methods, neural networks, fuzzy logic, and stochastic search methods. The book concludes with a chapter on Visualization and a higher-level overview of the IDA processes, which illustrates the breadth of application of the presented ideas.

We are glad to present the proceedings of the 5th biennial conference in the Intelligent Data Analysis series. The conference took place in Berlin, Germany, August 28–30, 2003. IDA has by now clearly grown up. Started as a small si- symposium of a larger conference in 1995 in Baden-Baden (Germany) it quickly attractedmoreinterest(bothsubmission-andattendance-wise),andmovedfrom London (1997) to Amsterdam (1999), and two years ago to Lisbon. Submission ratesalongwiththeeverimprovingqualityofpapershaveenabledtheor- nizers to assemble increasingly consistent and high-quality programs. This year we were again overwhelmed by yet another record-breaking submission rate of 180 papers. At the Program Chairs meeting we were – based on roughly 500 reviews – in the lucky position of carefully selecting 17 papers for oral and 42 for poster presentation. Poster presenters were given the opportunity to summarize their papers in 3-minute spotlight presentations. The oral, spotlight and poster presentations were then scheduled in a single-track, 2. 5-day conference program, summarized in this book. In accordance with the goal of IDA, “to bring together researchers from diverse disciplines,” we achieved a nice balance of presentations from the more theoreticalside(bothstatisticsandcomputerscience)aswellasmoreapplicati- oriented areas that illustrate how these techniques can be used in practice. Work presented in these proceedings ranges from theoretical contributions dealing, for example, with data cleaning and compression all the way to papers addressing practical problems in the areas of text classi?cation and sales-rate predictions. A considerable number of papers also center around the currently so popular applications in bioinformatics.

This book constitutes the refereed proceedings of the Second International Symposium on Computational Life Sciences, CompLife 2006, held in Cambridge, UK, in September 2006. The 25 revised full papers presented were carefully reviewed and selected from 56 initial submissions. The papers are organized in topical sections on genomics, data mining, molecular simulation, molecular informatics, systems biology, biological networks/metabolism, and computational neuroscience.

This monograph is a detailed introductory presentation of the key classes of intelligent data analysis methods. The twelve coherently written chapters by leading experts provide complete coverage of the core issues. The first half of the book is devoted to the discussion of classical statistical issues, ranging from the basic concepts of probability, through general notions of inference, to advanced multivariate and time series methods, as well as a detailed discussion of the increasingly important Bayesian approaches and Support Vector Machines. The following chapters then concentrate on the area of machine learning and artificial intelligence and provide introductions into the topics of rule induction methods, neural networks, fuzzy logic, and stochastic search methods. The book concludes with a chapter on Visualization and a higher-level overview of the IDA processes, which illustrates the breadth of application of the presented ideas.

This book constitutes the refereed proceedings of the Second International Symposium on Intelligent Data Analysis, IDA-97, held in London, UK, in August 1997.The volume presents 50 revised full papers selected from a total of 107 submissions. Also included is a keynote, Intelligent Data Analysis: Issues and Opportunities, by David J. Hand. The papers are organized in sections on exploratory data analysis, preprocessing and tools; classification and feature selection; medical applications; soft computing; knowledge discovery and data mining; estimation and clustering; data quality; qualitative models.

Formanyyearstheintersectionofcomputing anddataanalysiscontainedme- based statistics packages and not much else. Recently, statisticians have - braced computing, computer scientists have started using statistical theories and methods, and researchers in all corners have invented algorithms to nd structure in vast online datasets. Data analysts now have access to tools for exploratory data analysis, decision tree induction, causal induction, function - timation,constructingcustomizedreferencedistributions,andvisualization,and thereareintelligentassistantsto adviseonmatters ofdesignandanalysis.There aretoolsfortraditional,relativelysmallsamples,andalsoforenormousdatasets. In all, the scope for probing data in new and penetrating ways has never been so exciting. The IDA-99 conference brings together a wide variety of researchers c- cerned with extracting knowledge from data, including people from statistics, machine learning, neural networks, computer science, pattern recognition, da- base management, and other areas.The strategiesadopted by people from these areas are often di erent, and a synergy results if this is recognized.The IDA series of conferences is intended to stimulate interaction between these di erent areas,sothatmorepowerfultoolsemergeforextractingknowledgefromdataand a better understanding is developed of the process of intelligent data analysis. The result is a conference that has a clear focus (one application area:intelligent data analysis) and a broad scope (many di erent methods and techniques).

This book constitutes the refereed proceedings of the Second International Symposium on Intelligent Data Analysis, IDA-97, held in London, UK, in August 1997.The volume presents 50 revised full papers selected from a total of 107 submissions. Also included is a keynote, Intelligent Data Analysis: Issues and Opportunities, by David J. Hand. The papers are organized in sections on exploratory data analysis, preprocessing and tools; classification and feature selection; medical applications; soft computing; knowledge discovery and data mining; estimation and clustering; data quality; qualitative models.

Weareproudtopresenttheproceedingsoftheseventhbiennialconferenceinthe Intelligent Data Analysis series. The conference took place in Ljubljana, Slo- nia, September 6-8, 2007. IDA continues to expand its scope, quality and size. It started as a small side-symposium as part of a larger conference in 1995 in Baden-Baden(Germany).It quickly attractedmoreinterest in both submissions and attendance as it moved to London (1997) and then Amsterdam (1999). The next three meetings were held in Lisbon (2001), Berlin (2003) and then Madrid in 2005. The improving quality of the submissions has enabled the organizers to assemble programs of ever-increasing consistency and quality. This year we madea rigorousselectionof33papersoutofalmost100submissions.Theresu- ing oral presentations were then scheduled in a single-track, two-and-a-half-day conference program, summarized in the book that you have before you. In accordance with the stated IDA goal of “bringing together researchers from diverse disciplines,” we believe we have achieved an excellent balance of presentationsfromthemoretheoretical–bothstatisticalandmachinelearning– to the more application-oriented areas that illustrate how these techniques can beusedinpractice.Forexample,theproceedingsincludepaperswiththeoretical contributions dealing with statistical approaches to sequence alignment as well as papers addressing practical problems in the areas of text classi?cation and medical data analysis. It is reassuring to see that IDA continues to bring such diverse areas together, thus helping to cross-fertilize these ?elds.

Weareproudtopresenttheproceedingsoftheseventhbiennialconferenceinthe Intelligent Data Analysis series. The conference took place in Ljubljana, Slo- nia, September 6-8, 2007. IDA continues to expand its scope, quality and size. It started as a small side-symposium as part of a larger conference in 1995 in Baden-Baden(Germany).It quickly attractedmoreinterest in both submissions and attendance as it moved to London (1997) and then Amsterdam (1999). The next three meetings were held in Lisbon (2001), Berlin (2003) and then Madrid in 2005. The improving quality of the submissions has enabled the organizers to assemble programs of ever-increasing consistency and quality. This year we madea rigorousselectionof33papersoutofalmost100submissions.Theresu- ing oral presentations were then scheduled in a single-track, two-and-a-half-day conference program, summarized in the book that you have before you. In accordance with the stated IDA goal of “bringing together researchers from diverse disciplines,” we believe we have achieved an excellent balance of presentationsfromthemoretheoretical–bothstatisticalandmachinelearning– to the more application-oriented areas that illustrate how these techniques can beusedinpractice.Forexample,theproceedingsincludepaperswiththeoretical contributions dealing with statistical approaches to sequence alignment as well as papers addressing practical problems in the areas of text classi?cation and medical data analysis. It is reassuring to see that IDA continues to bring such diverse areas together, thus helping to cross-fertilize these ?elds.

It is our pleasure to present the proceedings of Discovery Science 2008, the 11th International Conference on Discovery Science held in Budapest, Hungary, October 13-16, 2008. It was co-located with ALT 2008, the 19th International Conference on Algorithmic Learning Theory, whose proceedings are available in the twin volume LNAI 5254. This combination of DS and ALT conferences has been successfully organized each year since 2002. It provides a forum for the researchersworking on many di?erent aspects of scienti?c discovery. Indeed, ALT/DS 2008 covered both the possibility to automate part of the scienti?c discoveryandthenecessarysupporttothehumanprocessofdiscoveryinscience. Interestingly, this co-location also provided the opportunity for an exciting joint program of tutorials and invited talks. The number of submitted papers was 58, i.e., slightly more than the previous year. The Program Committee members were involved in a rigorous selection process based on three reviews per paper. At the end, we selected 26 long papers thanks to the recommendations of the experts based on relevance, novelty, signi?cance, technical quality, and clarity. Although some short papers were submitted, none of them was selected.

It is our pleasure to present the proceedings of Discovery Science 2008, the 11th International Conference on Discovery Science held in Budapest, Hungary, October 13-16, 2008. It was co-located with ALT 2008, the 19th International Conference on Algorithmic Learning Theory, whose proceedings are available in the twin volume LNAI 5254. This combination of DS and ALT conferences has been successfully organized each year since 2002. It provides a forum for the researchersworking on many di?erent aspects of scienti?c discovery. Indeed, ALT/DS 2008 covered both the possibility to automate part of the scienti?c discoveryandthenecessarysupporttothehumanprocessofdiscoveryinscience. Interestingly, this co-location also provided the opportunity for an exciting joint program of tutorials and invited talks. The number of submitted papers was 58, i.e., slightly more than the previous year. The Program Committee members were involved in a rigorous selection process based on three reviews per paper. At the end, we selected 26 long papers thanks to the recommendations of the experts based on relevance, novelty, signi?cance, technical quality, and clarity. Although some short papers were submitted, none of them was selected.

This monograph is a detailed introductory presentation of the key classes of intelligent data analysis methods. The twelve coherently written chapters by leading experts provide complete coverage of the core issues. The first half of the book is devoted to the discussion of classical statistical issues, ranging from the basic concepts of probability, through general notions of inference, to advanced multivariate and time series methods, as well as a detailed discussion of the increasingly important Bayesian approaches and Support Vector Machines. The following chapters then concentrate on the area of machine learning and artificial intelligence and provide introductions into the topics of rule induction methods, neural networks, fuzzy logic, and stochastic search methods. The book concludes with a chapter on Visualization and a higher-level overview of the IDA processes, which illustrates the breadth of application of the presented ideas.

The background to IDA 2010, the 9th International Symposium on Intelligent DataAnalysis(IDA),is ratherunusual. Previously,thesymposiawereheldbi- nially at European venues. Over this time, the IDA Symposium had established an identity, a dedicated group of Program Committee members, and a regular audience. However, this success had come at a cost to the original ambitions for the symposium - concerned with interfacing AI, statistics and computer science for important and di?cult real-world data analysis problems - being comp- mised in favor of more standard data mining content. IDA 2010 was organized explicitly to re-align the IDA Symposia series with a set of objectives evolved from the original ambitions. This should be construed not as a criticism of r- tine data mining research but rather as an admission that the IDA symposium had taken the path of least resistance with respect to the call for papers and the reviewing process. This is the proceedings volume of IDA 2010, a special event held only a year after the eighth symposium in an attempt to revitalize the area of IDA. There were two major changes compared to previous symposia.First, the Call for - pers (CfP) was completely rewritten, placing great emphasis on algorithms and systems thatsupportmodelling andanalysisofcomplex real-worldsystems. - reover, the CfP explicitly discouraged submissions that might be characterized as "incrementaladvances indata mining algorithms. "Second, the reviewing- chanism was extended to include a "senior ProgrammeCommittee," in response to perceived shortcomings in the existing reviewing process.

Modern knowledge discovery methods enable users to discover complex patterns of various types in large information repositories. However, the underlying assumption has always been that the data to which the methods are applied to originates from one domain. The focus of this book, and the BISON project from which the contributions are originating, is a network based integration of various types of data repositories and the development of new ways to analyse and explore the resulting gigantic information networks. Instead of finding well defined global or local patterns they wanted to find domain bridging associations which are, by definition, not well defined since they will be especially interesting if they are sparse and have not been encountered before. The 32 contributions presented in this state-of-the-art volume together with a detailed introduction to the book are organized in topical sections on bisociation; representation and network creation; network analysis; exploration; and applications and evaluation.

In recent years there has been a growing interest to extend classical methods for data analysis.The aim is to allow a more flexible modeling of phenomena such as uncertainty, imprecision or ignorance.Such extensions of classical probability theory and statistics are useful in many real-life situations, since uncertainties in data are not only present in the form of randomness --- various types of incomplete or subjective information have to be handled.About twelve years ago the idea of strengthening the dialogue between the various research communities in the field of data analysis was born and resulted in the International Conference Series on Soft Methods in Probability and Statistics (SMPS).This book gathers contributions presented at the SMPS'2012 held in Konstanz, Germany. Its aim is to present recent results illustrating new trends in intelligent data analysis.It gives a comprehensive overview of current research into the fusion of soft computing methods with probability and statistics.Synergies of both fields might improve intelligent data analysis methods in terms of robustness to noise and applicability to larger datasets, while being able to efficiently obtain understandable solutions of real-world problems.