Machine Learning: Foundations, Methodologies, and Applications – serie

This book introduces readers to an evolutionary learning approach, specifically genetic programming (GP), for production scheduling. In Part I, it provides an introduction to production scheduling, existing solution methods, and the GP approach to production scheduling.

This book introduces readers to an evolutionary learning approach, specifically genetic programming (GP), for production scheduling. In Part I, it provides an introduction to production scheduling, existing solution methods, and the GP approach to production scheduling.

The book trains readers to break down various ML applications and methods in terms of data, model, and loss, thus helping them to choose from the vast range of ready-made ML methods. The book’s three-component approach to ML provides uniform coverage of a wide range of concepts and techniques.

The book trains readers to break down various ML applications and methods in terms of data, model, and loss, thus helping them to choose from the vast range of ready-made ML methods. The book’s three-component approach to ML provides uniform coverage of a wide range of concepts and techniques.

The excellent generalizability of deep learning is like a “cloud” to conventional complexity-based learning theory: the over-parameterization of deep learning makes almost all existing tools vacuous.

Entering the field of artificial intelligence and data science can seem daunting to beginners with little to no prior background, especially those with no programming experience.

In contrast to traditional evolutionary searches, which solve a single task in a single run, evolutionary multi-tasking algorithm conducts searches concurrently on multiple search spaces corresponding to different tasks or optimization problems,each possessing a unique function landscape.

In contrast to traditional evolutionary searches, which solve a single task in a single run, evolutionary multi-tasking algorithm conducts searches concurrently on multiple search spaces corresponding to different tasks or optimization problems,each possessing a unique function landscape.

This book offers a brief but effective introduction to quantum machine learning (QML). Instead, to immerse the reader in the quantum realm from the outset, the book starts from fundamental notions of quantum mechanics and quantum computing.

This book offers a brief but effective introduction to quantum machine learning (QML). Instead, to immerse the reader in the quantum realm from the outset, the book starts from fundamental notions of quantum mechanics and quantum computing.

This book introduces readers to the fundamentals of and recent advances in federated learning, focusing on reducing communication costs, improving computational efficiency, and enhancing the security level.

This book introduces readers to the fundamentals of and recent advances in federated learning, focusing on reducing communication costs, improving computational efficiency, and enhancing the security level. Federated learning is a distributed machine learning paradigm which enables model training on a large body of decentralized data. Its goal is to make full use of data across organizations or devices while meeting regulatory, privacy, and security requirements. The book starts with a self-contained introduction to artificial neural networks, deep learning models, supervised learning algorithms, evolutionary algorithms, and evolutionary learning. Concise information is then presented on multi-party secure computation, differential privacy, and homomorphic encryption, followed by a detailed description of federated learning. In turn, the book addresses the latest advances in federate learning research, especially from the perspectives of communication efficiency, evolutionarylearning, and privacy preservation.The book is particularly well suited for graduate students, academic researchers, and industrial practitioners in the field of machine learning and artificial intelligence. It can also be used as a self-learning resource for readers with a science or engineering background, or as a reference text for graduate courses.

Transfer learning is one of the most important technologies in the era of artificial intelligence and deep learning. It seeks to leverage existing knowledge by transferring it to another, new domain. Over the years, a number of relevant topics have attracted the interest of the research and application community: transfer learning, pre-training and fine-tuning, domain adaptation, domain generalization, and meta-learning.This book offers a comprehensive tutorial on an overview of transfer learning, introducing new researchers in this area to both classic and more recent algorithms. Most importantly, it takes a “student’s” perspective to introduce all the concepts, theories, algorithms, and applications, allowing readers to quickly and easily enter this area. Accompanying the book, detailed code implementations are provided to better illustrate the core ideas of several important algorithms, presenting good examples for practice.

Transfer learning is one of the most important technologies in the era of artificial intelligence and deep learning. It seeks to leverage existing knowledge by transferring it to another, new domain. Over the years, a number of relevant topics have attracted the interest of the research and application community: transfer learning, pre-training and fine-tuning, domain adaptation, domain generalization, and meta-learning.This book offers a comprehensive tutorial on an overview of transfer learning, introducing new researchers in this area to both classic and more recent algorithms. Most importantly, it takes a “student’s” perspective to introduce all the concepts, theories, algorithms, and applications, allowing readers to quickly and easily enter this area. Accompanying the book, detailed code implementations are provided to better illustrate the core ideas of several important algorithms, presenting good examples for practice.

Graph Neural Networks (GNNs) have revolutionized the way we learn representations from graph-structured data, becoming a cornerstone for applications in social networks, recommendation systems, biology, and beyond. However, mainstream GNNs rely heavily on message passing, an iterative process of propagating information between connected nodes. While powerful, this method often incurs significant computational costs, making efficient training a growing challenge as graph sizes scale up.This book addresses these challenges by offering a comprehensive exploration of efficient GNN training through the lens of data management. It highlights how innovative techniques, rooted in decades of graph processing research, can optimize the entire training process without compromising performance. By focusing on system-level enhancements and practical solutions, it provides actionable strategies to overcome efficiency bottlenecks in large-scale GNN training.Readers will gain a deeper understanding of the graph data lifecycle in GNN training, with examples that demonstrate how data management techniques can significantly enhance scalability and performance. The book is designed for a broad audience, including students, researchers, and professionals, offering clear explanations and practical insights for anyone looking to master efficient GNN training.

This book introduces the prevailing domains of recommender systems and cross-device federated learning, highlighting the latest research progress and prospects regarding cross-device federated recommendation.

This book introduces the prevailing domains of recommender systems and cross-device federated learning, highlighting the latest research progress and prospects regarding cross-device federated recommendation. As a privacy-oriented distributed computing paradigm, cross-device federated learning enables collaborative intelligence across multiple devices while ensuring the security of local data. In this context, ubiquitous recommendation services emerge as a crucial application of device-side AI, making a deep exploration of federated recommendation systems highly significant.This book is self-contained, and each chapter can be comprehended independently. Overall, the book organizes existing efforts in federated recommendation from three different perspectives. The perspective of learning paradigms includes statistical machine learning, deep learning, reinforcement learning, and meta learning, where each has detailed techniques (e.g., different neural building blocks) to present relevant studies. The perspective of privacy computing covers homomorphic encryption, differential privacy, secure multi-party computing, and malicious attacks. More specific encryption and obfuscation techniques, such as randomized response and secret sharing, are involved. The perspective of federated issues discusses communication optimization and fairness perception, which are widely concerned in the cross-device distributed environment. In the end, potential issues and promising directions for future research are identified point by point.This book is especially suitable for researchers working on the application of recommendation algorithms to the privacy-preserving federated scenario. The target audience includes graduate students, academic researchers, and industrial practitioners who specialize in recommender systems, distributed machine learning, information retrieval, information security, or artificial intelligence.

While existing books address collaboration control, perception, and learning, there is a gap in focusing on active perception and interactive learning for embodied multi-agent systems.

In recent years, embodied multi-agent systems, including multi-robots, have emerged as essential solution for demanding tasks such as search and rescue, environmental monitoring, and space exploration. Effective collaboration among these agents is crucial but presents significant challenges due to differences in morphology and capabilities, especially in heterogenous systems. While existing books address collaboration control, perception, and learning, there is a gap in focusing on active perception and interactive learning for embodied multi-agent systems.This book aims to bridge this gap by establishing a unified framework for perception and learning in embodied multi-agent systems. It presents and discusses the perception-action-learning loop, offering systematic solutions for various types of agents—homogeneous, heterogeneous, and ad hoc. Beyond the popular reinforcement learning techniques, the book provides insights into using fundamental models to tackle complex collaboration problems.By interchangeably utilizing constrained optimization, reinforcement learning, and fundamental models, this book offers a comprehensive toolkit for solving different types of embodied multi-agent problems. Readers will gain an understanding of the advantages and disadvantages of each method for various tasks. This book will be particularly valuable to graduate students and professional researchers in robotics and machine learning. It provides a robust learning framework for addressing practical challenges in embodied multi-agent systems and demonstrates the promising potential of fundamental models for scenario generation, policy learning, and planning in complex collaboration problems.

mso-fareast-font-family: 'Times New Roman';">Readers will benefit from a comprehensive yet concise presentation of modern DFO methods, gaining theoretical insights and practical tools to enhance their research and problem-solving capabilities.

Although topic models have seen significant achievements over the past three decades, there remains a scarcity of methods that effectively model temporal aspect. Additionally, the challenge of coherent topic modeling is particularly relevant due to the noise and large scale of social media datasets.

This textbook offers a comprehensive and accessible introduction to machine learning with the Julia programming language. It bridges mathematical theory and real-world practice, guiding readers through both foundational concepts and advanced algorithms. Covering topics from essential principles like Kullback–Leibler divergence and eigen-analysis to cutting-edge techniques such as deep transfer learning and differential privacy, each chapter delivers clear explanations and detailed algorithmic treatments. Sample code accompanies every major topic, enabling hands-on learning and faster implementation.By leveraging Julia’s powerful machine learning ecosystem—including libraries such as Flux.jl, MLJ.jl, and more—this book empowers readers to build robust, state-of-the-art machine learning models.Ideal for students, researchers, and professionals alike, this textbook is designed for those seeking a solid theoretical foundation in machine learning, along with deep algorithmic insight and practical problem-solving inspiration.

Today, machine learning algorithms are often distributed across multiple machines to leverage more computing power and more data. However, the use of a distributed framework entails a variety of security threats. In particular, some of the machines may misbehave and jeopardize the learning procedure. This could, for example, result from hardware and software bugs, data poisoning or a malicious player controlling a subset of the machines. This book explains in simple terms what it means for a distributed machine learning scheme to be robust to these threats, and how to build provably robust machine learning algorithms.Studying the robustness of machine learning algorithms is a necessity given the ubiquity of these algorithms in both the private and public sectors. Accordingly, over the past few years, we have witnessed a rapid growth in the number of articles published on the robustness of distributed machine learning algorithms. We believe it is time to provide a clear foundation to this emerging and dynamic field. By gathering the existing knowledge and democratizing the concept of robustness, the book provides the basis for a new generation of reliable and safe machine learning schemes. In addition to introducing the problem of robustness in modern machine learning algorithms, the book will equip readers with essential skills for designing distributed learning algorithms with enhanced robustness. Moreover, the book provides a foundation for future research in this area.

This book explains in simple terms what it means for a distributed machine learning scheme to be robust to these threats, and how to build provably robust machine learning algorithms.Studying the robustness of machine learning algorithms is a necessity given the ubiquity of these algorithms in both the private and public sectors.

Unsupervised domain adaptation (UDA) is a challenging problem in machine learning where the model is trained on a source domain with labeled data and tested on a target domain with unlabeled data. In recent years, UDA has received significant attention from the research community due to its applicability in various real-world scenarios. This book provides a comprehensive review of state-of-the-art UDA methods and explores new variants of UDA that have the potential to advance the field.The book begins with a clear introduction to the UDA problem and is mainly organized into four technical sections, each focused on a specific piece of UDA research. The first section covers criterion optimization-based UDA, which aims to learn domain-invariant representations by minimizing the discrepancy between source and target domains. The second section discusses bi-classifier adversarial learning-based UDA, which creatively leverages adversarial learning by conducting a minimax game between the feature extractor and two task classifiers. The third section introduces source-free UDA, a novel UDA setting that does not require any raw data from the source domain. The fourth section presents active learning for UDA, which combines domain adaptation and active learning to reduce the amount of labeled data needed for adaptation.This book is suitable for researchers, graduate students, and practitioners who are interested in UDA and its applications in various fields, primarily in computer vision. The chapters are authored by leading experts in the field and provide a comprehensive and in-depth analysis of the current UDA methods and new directions for future research. With its broad coverage and cutting-edge research, this book is a valuable resource for anyone looking to advance their knowledge of UDA.

Unsupervised domain adaptation (UDA) is a challenging problem in machine learning where the model is trained on a source domain with labeled data and tested on a target domain with unlabeled data.

Artificial intelligence (AI) is rapidly gaining significance in the business world. With more and more organizations adopt AI technologies, there is a growing demand for business leaders, managers, and practitioners who can harness AI’s potential to improve operations, increase efficiency, and drive innovation.This book aims to help management professionals exploit the predictive powers of AI and demonstrate to AI practitioners how to apply their expertise in fundamental business operations. It showcases how AI technology innovations can enhance various aspects of business management, such as business strategy, finance, and marketing. Readers interested in AI for business management will find several topics of particular interest, including how AI can improve decision-making in business strategy, streamline operational processes, and enhance customer satisfaction.As AI becomes an increasingly important tool in the business world, this book offers valuable insightsinto how it can be applied to various industries and business settings. Through this book, readers will gain a better understanding of how AI can be applied to improve business management practices and practical guidance on how to implement AI projects in a business context. This book also provides practical guides on how to implement AI projects in a business context using Python programming. By reading this book, readers will be better equipped to make informed decisions about how to leverage AI for business success.

Artificial intelligence (AI) is rapidly gaining significance in the business world. With more and more organizations adopt AI technologies, there is a growing demand for business leaders, managers, and practitioners who can harness AI’s potential to improve operations, increase efficiency, and drive innovation.This book aims to help management professionals exploit the predictive powers of AI and demonstrate to AI practitioners how to apply their expertise in fundamental business operations. It showcases how AI technology innovations can enhance various aspects of business management, such as business strategy, finance, and marketing. Readers interested in AI for business management will find several topics of particular interest, including how AI can improve decision-making in business strategy, streamline operational processes, and enhance customer satisfaction.As AI becomes an increasingly important tool in the business world, this book offers valuable insightsinto how it can be applied to various industries and business settings. Through this book, readers will gain a better understanding of how AI can be applied to improve business management practices and practical guidance on how to implement AI projects in a business context. This book also provides practical guides on how to implement AI projects in a business context using Python programming. By reading this book, readers will be better equipped to make informed decisions about how to leverage AI for business success.