Chong Li - Böcker

Reinforcement Learning for Cyber-Physical Systems: with Cybersecurity Case Studies was inspired by recent developments in the fields of reinforcement learning (RL) and cyber-physical systems (CPSs). Rooted in behavioral psychology, RL is one of the primary strands of machine learning. Different from other machine learning algorithms, such as supervised learning and unsupervised learning, the key feature of RL is its unique learning paradigm, i.e., trial-and-error. Combined with the deep neural networks, deep RL become so powerful that many complicated systems can be automatically managed by AI agents at a superhuman level. On the other hand, CPSs are envisioned to revolutionize our society in the near future. Such examples include the emerging smart buildings, intelligent transportation, and electric grids. However, the conventional hand-programming controller in CPSs could neither handle the increasing complexity of the system, nor automatically adapt itself to new situations that it has never encountered before. The problem of how to apply the existing deep RL algorithms, or develop new RL algorithms to enable the real-time adaptive CPSs, remains open. This book aims to establish a linkage between the two domains by systematically introducing RL foundations and algorithms, each supported by one or a few state-of-the-art CPS examples to help readers understand the intuition and usefulness of RL techniques. Features Introduces reinforcement learning, including advanced topics in RL Applies reinforcement learning to cyber-physical systems and cybersecurity Contains state-of-the-art examples and exercises in each chapter Provides two cybersecurity case studies Reinforcement Learning for Cyber-Physical Systems with Cybersecurity Case Studies is an ideal text for graduate students or junior/senior undergraduates in the fields of science, engineering, computer science, or applied mathematics. It would also prove useful to researchers and engineers interested in cybersecurity, RL, and CPS. The only background knowledge required to appreciate the book is a basic knowledge of calculus and probability theory.

A guide to the wide-variety of waste valorisation techniques related to various biomass, waste materials and by productsWaste Valorisation provides a comprehensive review of waste chemistry and its application to the generation of value-added products. The authors – noted experts on the topic – offer a clear understanding of waste diversity, drivers and policies governing its valorisation based on the location. The book provides information on the principles behind various valorisation schemes and offers a description of general treatment options with their evaluation guidelines in terms of cost, energy consumption and waste generation.Each of the book's chapters contain an introduction which summarises the current production and processing methods, yields, energy sources and other pertinent information for each specific type of waste. The authors focus on the most relevant novel technologies for value-added processing of waste streams or industrial by-products which can readily be integrated into current waste management systems. They also provide the pertinent technical, economic, social and environmental evaluations of bioconversions as future sustainable technologies in a biorefinery. This important book: Presents the most current technologies which integrate waste and/or by-product valorisationIncludes discussions on end-product purity and life-cycle assessment challengesExplores relevant novel technologies for value-added processing of waste streams or industrial by-products which can be integrated into current waste management systemsOffers a guide to waste reuse, a key sustainability goal for existing biorefineries wishing to reduce material and environmental costsWritten for academic researchers and industrial scientists working in agricultural and food production, bioconversions and waste management professionals, Waste Valorisation is an authoritative guide to the chemistry and applications of waste materials and provides an overview of the most recent developments in the field.

Reinforcement Learning for Cyber-Physical Systems: with Cybersecurity Case Studies was inspired by recent developments in the fields of reinforcement learning (RL) and cyber-physical systems (CPSs). Rooted in behavioral psychology, RL is one of the primary strands of machine learning. Different from other machine learning algorithms, such as supervised learning and unsupervised learning, the key feature of RL is its unique learning paradigm, i.e., trial-and-error. Combined with the deep neural networks, deep RL become so powerful that many complicated systems can be automatically managed by AI agents at a superhuman level. On the other hand, CPSs are envisioned to revolutionize our society in the near future. Such examples include the emerging smart buildings, intelligent transportation, and electric grids. However, the conventional hand-programming controller in CPSs could neither handle the increasing complexity of the system, nor automatically adapt itself to new situations that it has never encountered before. The problem of how to apply the existing deep RL algorithms, or develop new RL algorithms to enable the real-time adaptive CPSs, remains open. This book aims to establish a linkage between the two domains by systematically introducing RL foundations and algorithms, each supported by one or a few state-of-the-art CPS examples to help readers understand the intuition and usefulness of RL techniques. Features Introduces reinforcement learning, including advanced topics in RL Applies reinforcement learning to cyber-physical systems and cybersecurity Contains state-of-the-art examples and exercises in each chapter Provides two cybersecurity case studies Reinforcement Learning for Cyber-Physical Systems with Cybersecurity Case Studies is an ideal text for graduate students or junior/senior undergraduates in the fields of science, engineering, computer science, or applied mathematics. It would also prove useful to researchers and engineers interested in cybersecurity, RL, and CPS. The only background knowledge required to appreciate the book is a basic knowledge of calculus and probability theory.

The research purpose of this book is to advance the reform of the existing international monetary system through the establishment of a new international currency standard that is a super-sovereign currency.

The research purpose of this book is to advance the reform of the existing international monetary system through the establishment of a new international currency standard that is a super-sovereign currency.