Studies in Big Data – serie

Deep Learning and Missing Data in Engineering Systems uses deep learning and swarm intelligence methods to cover missing data estimation in engineering systems. The missing data estimation processes proposed in the book can be applied in image recognition and reconstruction. To facilitate the imputation of missing data, several artificial intelligence approaches are presented, including:deep autoencoder neural networks;deep denoising autoencoder networks;the bat algorithm;the cuckoo search algorithm; andthe firefly algorithm.The hybrid models proposed are used to estimate the missing data in high-dimensional data settings more accurately. Swarm intelligence algorithms are applied to address critical questions such as model selection and model parameter estimation. The authors address feature extraction for the purpose of reconstructing the input data from reduced dimensions by the use of deep autoencoder neural networks. They illustrate new models diagrammatically, report their findings in tables, so as to put their methods on a sound statistical basis. The methods proposed speed up the process of data estimation while preserving known features of the data matrix. This book is a valuable source of information for researchers and practitioners in data science. Advanced undergraduate and postgraduate students studying topics in computational intelligence and big data, can also use the book as a reference for identifying and introducing new research thrusts in missing data estimation.

This provides a comprehensive overview of the key principles of security concerns surrounding the upcoming Internet of Things (IoT), and introduces readers to the protocols adopted in the IoT. It also analyses the vulnerabilities, attacks and defense mechanisms, highlighting the security issues in the context of big data. Lastly, trust management approaches and ubiquitous learning applications are examined in detail. As such, the book sets the stage for developing and securing IoT applications both today and in the future.

This book introduces the latest research findings in cloud, edge, fog, and mist computing and their applications in various fields using geospatial data. It solves a number of problems of cloud computing and big data, such as scheduling, security issues using different techniques, which researchers from industry and academia have been attempting to solve in virtual environments. Some of these problems are of an intractable nature and so efficient technologies like fog, edge and mist computing play an important role in addressing these issues. By exploring emerging advances in cloud computing and big data analytics and their engineering applications, the book enables researchers to understand the mechanisms needed to implement cloud, edge, fog, and mist computing in their own endeavours, and motivates them to examine their own research findings and developments.

This book reflects the author’s years of hands-on experience as an academic and practitioner. It is primarily intended for executives, managers and practitioners who want to redefine the way they think about artificial intelligence (AI) and other exponential technologies. Accordingly the book, which is structured as a collection of largely self-contained articles, includes both general strategic reflections and detailed sector-specific information. More concretely, it shares insights into what it means to work with AI and how to do it more efficiently; what it means to hire a data scientist and what new roles there are in the field; how to use AI in specific industries such as finance or insurance; how AI interacts with other technologies such as blockchain; and, in closing, a review of the use of AI in venture capital, as well as a snapshot of acceleration programs for AI companies.

This book presents an overview of techniques for discovering high-utility patterns (patterns with a high importance) in data. It introduces the main types of high-utility patterns, as well as the theory and core algorithms for high-utility pattern mining, and describes recent advances, applications, open-source software, and research opportunities. It also discusses several types of discrete data, including customer transaction data and sequential data.The book consists of twelve chapters, seven of which are surveys presenting the main subfields of high-utility pattern mining, including itemset mining, sequential pattern mining, big data pattern mining, metaheuristic-based approaches, privacy-preserving pattern mining, and pattern visualization. The remaining five chapters describe key techniques and applications, such as discovering concise representations and regular patterns.

This book discusses text mining and different ways this type of data mining can be used to find implicit knowledge from text collections. The author provides the guidelines for implementing text mining systems in Java, as well as concepts and approaches. The book starts by providing detailed text preprocessing techniques and then goes on to provide concepts, the techniques, the implementation, and the evaluation of text categorization. It then goes into more advanced topics including text summarization, text segmentation, topic mapping, and automatic text management.

This book highlights some of the most fascinating current uses, thought-provoking changes, and biggest challenges that Big Data means for our society. The explosive growth of data and advances in Big Data analytics have created a new frontier for innovation, competition, productivity, and well-being in almost every sector of our society, as well as a source of immense economic and societal value. From the derivation of customer feedback-based insights to fraud detection and preserving privacy; better medical treatments; agriculture and food management; and establishing low-voltage networks – many innovations for the greater good can stem from Big Data. Given the insights it provides, this book will be of interest to both researchers in the field of Big Data, and practitioners from various fields who intend to apply Big Data technologies to improve their strategic and operational decision-making processes.

This book approaches big data, artificial intelligence, machine learning, and business intelligence through the lens of Data Science. We have grown accustomed to seeing these terms mentioned time and time again in the mainstream media. However, our understanding of what they actually mean often remains limited. This book provides a general overview of the terms and approaches used broadly in data science, and provides detailed information on the underlying theories, models, and application scenarios. Divided into three main parts, it addresses what data science is; how and where it is used; and how it can be implemented using modern open source software. The book offers an essential guide to modern data science for all students, practitioners, developers and managers seeking a deeper understanding of how various aspects of data science work, and of how they can be employed to gain a competitive advantage.

This edited book covers recent advances of techniques, methods and tools treating the problem of learning from data streams generated by evolving non-stationary processes. The goal is to discuss and overview the advanced techniques, methods and tools that are dedicated to manage, exploit and interpret data streams in non-stationary environments. The book includes the required notions, definitions, and background to understand the problem of learning from data streams in non-stationary environments and synthesizes the state-of-the-art in the domain, discussing advanced aspects and concepts and presenting open problems and future challenges in this field.Provides multiple examples to facilitate the understanding data streams in non-stationary environments;Presents several application cases to show how the methods solve different real world problems;Discusses the links between methods to help stimulate new research and application directions.

The inspiration for this book came from the Industrial Session of the ISMIS 2017 Conference in Warsaw. It covers numerous applications of intelligent technologies in various branches of the industry. Intelligent computational methods and big data foster innovation and enable the industry to overcome technological limitations and explore the new frontiers. Therefore it is necessary for scientists and practitioners to cooperate and inspire each other, and use the latest research findings to create new designs and products. As such, the contributions cover solutions to the problems experienced by practitioners in the areas of artificial intelligence, complex systems, data mining, medical applications and bioinformatics, as well as multimedia- and text processing. Further, the book shows new directions for cooperation between science and industry and facilitates efficient transfer of knowledge in the area of intelligent information systems.

This book discusses harnessing the real power of cloud computing in optimization problems, presenting state-of-the-art computing paradigms, advances in applications, and challenges concerning both the theories and applications of cloud computing in optimization with a focus on diverse fields like the Internet of Things, fog-assisted cloud computing, and big data. In real life, many problems – ranging from social science to engineering sciences – can be identified as complex optimization problems. Very often these are intractable, and as a result researchers from industry as well as the academic community are concentrating their efforts on developing methods of addressing them. Further, the cloud computing paradigm plays a vital role in many areas of interest, like resource allocation, scheduling, energy management, virtualization, and security, and these areas are intertwined with many optimization problems. Using illustrations and figures, this book offers students and researchers a clear overview of the concepts and practices of cloud computing and its use in numerous complex optimization problems.

This book reviews the state of the art of big data analysis and smart city. It includes issues which pertain to signal processing, probability models, machine learning, data mining, database, data engineering, pattern recognition, visualisation, predictive analytics, data warehousing, data compression, computer programming, smart city, etc. Data is becoming an increasingly decisive resource in modern societies, economies, and governmental organizations. Data science inspires novel techniques and theories drawn from mathematics, statistics, information theory, computer science, and social science. Papers in this book were the outcome of research conducted in this field of study. The latter makes use of applications and techniques related to data analysis in general and big data and smart city in particular.The book appeals to advanced undergraduate and graduate students, postdoctoral researchers, lecturers and industrial researchers, as well as anyone interested in big data analysis and smart city.

This book reviews the state of the art of big data analysis and smart city. It includes issues which pertain to signal processing, probability models, machine learning, data mining, database, data engineering, pattern recognition, visualisation, predictive analytics, data warehousing, data compression, computer programming, smart city, etc. Data is becoming an increasingly decisive resource in modern societies, economies, and governmental organizations. Data science inspires novel techniques and theories drawn from mathematics, statistics, information theory, computer science, and social science. Papers in this book were the outcome of research conducted in this field of study. The latter makes use of applications and techniques related to data analysis in general and big data and smart city in particular.The book appeals to advanced undergraduate and graduate students, postdoctoral researchers, lecturers and industrial researchers, as well as anyone interested in big data analysis and smart city.

This provides a comprehensive overview of the key principles of security concerns surrounding the upcoming Internet of Things (IoT), and introduces readers to the protocols adopted in the IoT. It also analyses the vulnerabilities, attacks and defense mechanisms, highlighting the security issues in the context of big data. Lastly, trust management approaches and ubiquitous learning applications are examined in detail. As such, the book sets the stage for developing and securing IoT applications both today and in the future.

This book introduces methods of re-processing images to extract numerical information that can be used to quantify the observables in environmental modelling. Experiments or procedures that yield large images can be statistically or parametrically examined. Through the use of open source libraries, the book shows how ‘big data’ in the form of images or datasets can be comparatively analysed along same defined procedures or standards.  This book helps to solve the challenges of discarding datasets that are relevant directly or indirectly to the research. The habit of screening datasets leads to the discard of over 90% of the original dataset or images generated in the experiments or procedure. If the images or datasets are generated under the same principles or conditions, then each measurement may be the narrative of unique events. The focus of this book is to enlighten researchers on how to analyse measurements with the aim of ensuring 100% utilization.

This book introduces methods of re-processing images to extract numerical information that can be used to quantify the observables in environmental modelling. Experiments or procedures that yield large images can be statistically or parametrically examined. Through the use of open source libraries, the book shows how ‘big data’ in the form of images or datasets can be comparatively analysed along same defined procedures or standards.  This book helps to solve the challenges of discarding datasets that are relevant directly or indirectly to the research. The habit of screening datasets leads to the discard of over 90% of the original dataset or images generated in the experiments or procedure. If the images or datasets are generated under the same principles or conditions, then each measurement may be the narrative of unique events. The focus of this book is to enlighten researchers on how to analyse measurements with the aim of ensuring 100% utilization.

This book presents the Recommender System for Improving Customer Loyalty. New and innovative products have begun appearing from a wide variety of countries, which has increased the need to improve the customer experience. When a customer spends hundreds of thousands of dollars on a piece of equipment, keeping it running efficiently is critical to achieving the desired return on investment. Moreover, managers have discovered that delivering a better customer experience pays off in a number of ways. A study of publicly traded companies conducted by Watermark Consulting found that from 2007 to 2013, companies with a better customer service generated a total return to shareholders that was 26 points higher than the S&P 500. This is only one of many studies that illustrate the measurable value of providing a better service experience. The Recommender System presented here addresses several important issues. (1) It provides a decision framework to help managers determine which actions are likely to have the greatest impact on the Net Promoter Score. (2) The results are based on multiple clients. The data mining techniques employed in the Recommender System allow users to “learn” from the experiences of others, without sharing proprietary information. This dramatically enhances the power of the system. (3) It supplements traditional text mining options. Text mining can be used to identify the frequency with which topics are mentioned, and the sentiment associated with a given topic. The Recommender System allows users to view specific, anonymous comments associated with actual customers. Studying these comments can provide highly accurate insights into the steps that can be taken to improve the customer experience. (4) Lastly, the system provides a sensitivity analysis feature. In some cases, certain actions can be more easily implemented than others. The Recommender System allows managers to “weigh” these actions and determine which ones would have a greater impact.

This book presents the Recommender System for Improving Customer Loyalty. New and innovative products have begun appearing from a wide variety of countries, which has increased the need to improve the customer experience. When a customer spends hundreds of thousands of dollars on a piece of equipment, keeping it running efficiently is critical to achieving the desired return on investment. Moreover, managers have discovered that delivering a better customer experience pays off in a number of ways. A study of publicly traded companies conducted by Watermark Consulting found that from 2007 to 2013, companies with a better customer service generated a total return to shareholders that was 26 points higher than the S&P 500. This is only one of many studies that illustrate the measurable value of providing a better service experience. The Recommender System presented here addresses several important issues. (1) It provides a decision framework to help managers determine which actions are likely to have the greatest impact on the Net Promoter Score. (2) The results are based on multiple clients. The data mining techniques employed in the Recommender System allow users to “learn” from the experiences of others, without sharing proprietary information. This dramatically enhances the power of the system. (3) It supplements traditional text mining options. Text mining can be used to identify the frequency with which topics are mentioned, and the sentiment associated with a given topic. The Recommender System allows users to view specific, anonymous comments associated with actual customers. Studying these comments can provide highly accurate insights into the steps that can be taken to improve the customer experience. (4) Lastly, the system provides a sensitivity analysis feature. In some cases, certain actions can be more easily implemented than others. The Recommender System allows managers to “weigh” these actions and determine which ones would have a greater impact.

This book presents a unique approach to stream data mining. Unlike the vast majority of previous approaches, which are largely based on heuristics, it highlights methods and algorithms that are mathematically justified. First, it describes how to adapt static decision trees to accommodate data streams; in this regard, new splitting criteria are developed to guarantee that they are asymptotically equivalent to the classical batch tree. Moreover, new decision trees are designed, leading to the original concept of hybrid trees. In turn, nonparametric techniques based on Parzen kernels and orthogonal series are employed to address concept drift in the problem of non-stationary regressions and classification in a time-varying environment. Lastly, an extremely challenging problem that involves designing ensembles and automatically choosing their sizes is described and solved. Given its scope, the book is intended for a professional audience of researchers and practitioners who dealwith stream data, e.g. in telecommunication, banking, and sensor networks.

The book is devoted to the analysis of big data in order to extract from these data hidden patterns necessary for making decisions about the rational behavior of complex systems with the different nature that generate this data. To solve these problems, a group of new methods and tools is used, based on the self-organization of computational processes, the use of crisp and fuzzy cluster analysis methods, hybrid neural-fuzzy networks, and others. The book solves various practical problems. In particular, for the tasks of 3D image recognition and automatic speech recognition large-scale neural networks with applications for Deep Learning systems were used. Application of hybrid neuro-fuzzy networks for analyzing stock markets was presented. The analysis of big historical, economic and physical data revealed the hidden Fibonacci pattern about the course of systemic world conflicts and their connection with the Kondratieff big economic cycles and the Schwabe–Wolf solar activity cycles. The book is useful for system analysts and practitioners working with complex systems in various spheres of human activity.

This book presents a unified framework, based on specialized evolutionary algorithms, for the global induction of various types of classification and regression trees from data. The resulting univariate or oblique trees are significantly smaller than those produced by standard top-down methods, an aspect that is critical for the interpretation of mined patterns by domain analysts. The approach presented here is extremely flexible and can easily be adapted to specific data mining applications, e.g. cost-sensitive model trees for financial data or multi-test trees for gene expression data. The global induction can be efficiently applied to large-scale data without the need for extraordinary resources. With a simple GPU-based acceleration, datasets composed of millions of instances can be mined in minutes. In the event that the size of the datasets makes the fastest memory computing impossible, the Spark-based implementation on computer clusters, which offers impressive fault tolerance and scalability potential, can be applied.

This book presents a unified framework, based on specialized evolutionary algorithms, for the global induction of various types of classification and regression trees from data. The resulting univariate or oblique trees are significantly smaller than those produced by standard top-down methods, an aspect that is critical for the interpretation of mined patterns by domain analysts. The approach presented here is extremely flexible and can easily be adapted to specific data mining applications, e.g. cost-sensitive model trees for financial data or multi-test trees for gene expression data. The global induction can be efficiently applied to large-scale data without the need for extraordinary resources. With a simple GPU-based acceleration, datasets composed of millions of instances can be mined in minutes. In the event that the size of the datasets makes the fastest memory computing impossible, the Spark-based implementation on computer clusters, which offers impressive fault tolerance and scalability potential, can be applied.

The World Wide Web can be considered a huge library that in consequence needs a capable librarian responsible for the classification and retrieval of documents as well as the mediation between library resources and users. Based on this idea, the concept of the “Librarian of the Web” is introduced which comprises novel, librarian-inspired methods and technical solutions to decentrally search for text documents in the web using peer-to-peer technology.The concept’s implementation in the form of an interactive peer-to-peer client, called “WebEngine”, is elaborated on in detail. This software extends and interconnects common web servers creating a fully integrated, decentralised and self-organising web search system on top of the existing web structure. Thus, the web is turned into its own powerful search engine without the need for any central authority.This book is intended for researchers and practitioners having a solid background in the fields of Information Retrievaland Web Mining.

The World Wide Web can be considered a huge library that in consequence needs a capable librarian responsible for the classification and retrieval of documents as well as the mediation between library resources and users. Based on this idea, the concept of the “Librarian of the Web” is introduced which comprises novel, librarian-inspired methods and technical solutions to decentrally search for text documents in the web using peer-to-peer technology.The concept’s implementation in the form of an interactive peer-to-peer client, called “WebEngine”, is elaborated on in detail. This software extends and interconnects common web servers creating a fully integrated, decentralised and self-organising web search system on top of the existing web structure. Thus, the web is turned into its own powerful search engine without the need for any central authority.This book is intended for researchers and practitioners having a solid background in the fields of Information Retrievaland Web Mining.

In this book, the editors explain how students enrolled in two digital forensic courses at their institution are exposed to experiential learning opportunities, where the students acquire the knowledge and skills of the subject-matter while also learning how to adapt to the ever-changing digital forensic landscape. Their findings (e.g., forensic examination of different IoT devices) are also presented in the book. Digital forensics is a topic of increasing importance as our society becomes “smarter” with more of the “things” around us been internet- and inter-connected (e.g., Internet of Things (IoT) and smart home devices); thus, the increasing likelihood that we will need to acquire data from these things in a forensically sound manner. This book is of interest to both digital forensic educators and digital forensic practitioners, as well as students seeking to learn about digital forensics.

In this book, the editors explain how students enrolled in two digital forensic courses at their institution are exposed to experiential learning opportunities, where the students acquire the knowledge and skills of the subject-matter while also learning how to adapt to the ever-changing digital forensic landscape. Their findings (e.g., forensic examination of different IoT devices) are also presented in the book. Digital forensics is a topic of increasing importance as our society becomes “smarter” with more of the “things” around us been internet- and inter-connected (e.g., Internet of Things (IoT) and smart home devices); thus, the increasing likelihood that we will need to acquire data from these things in a forensically sound manner. This book is of interest to both digital forensic educators and digital forensic practitioners, as well as students seeking to learn about digital forensics.

The book provides readers with an overview of the state of the art in the field of Industry 4.0 and related research advancements. The respective chapters identify and discuss new dimensions of both risk factors and success factors, along with performance metrics that can be employed in future research work. They also discuss a number of real-time issues, problems and applications with corresponding solutions and suggestions. Sharing new theoretical findings, tools and techniques for Industry 4.0, and covering both theoretical and application-oriented approaches, the book offers a valuable asset for newcomers to the field and practicing professionals alike.

The book provides readers with an overview of the state of the art in the field of Industry 4.0 and related research advancements. The respective chapters identify and discuss new dimensions of both risk factors and success factors, along with performance metrics that can be employed in future research work. They also discuss a number of real-time issues, problems and applications with corresponding solutions and suggestions. Sharing new theoretical findings, tools and techniques for Industry 4.0, and covering both theoretical and application-oriented approaches, the book offers a valuable asset for newcomers to the field and practicing professionals alike.

This book includes state-of-the-art discussions on various issues and aspects of the implementation, testing, validation, and application of big data in the context of healthcare. The concept of big data is revolutionary, both from a technological and societal well-being standpoint. This book provides a comprehensive reference guide for engineers, scientists, and students studying/involved in the development of big data tools in the areas of healthcare and medicine. It also features a multifaceted and state-of-the-art literature review on healthcare data, its modalities, complexities, and methodologies, along with mathematical formulations. The book is divided into two main sections, the first of which discusses the challenges and opportunities associated with the implementation of big data in the healthcare sector. In turn, the second addresses the mathematical modeling of healthcare problems, as well as current and potential future big data applications and platforms.