IEEE Press Series on Systems Science and Engineering – serie

Reinforcement and Systemic Machine Learning for Decision Making There are always difficulties in making machines that learn from experience. Complete information is not always available—or it becomes available in bits and pieces over a period of time. With respect to systemic learning, there is a need to understand the impact of decisions and actions on a system over that period of time. This book takes a holistic approach to addressing that need and presents a new paradigm—creating new learning applications and, ultimately, more intelligent machines.The first book of its kind in this new and growing field, Reinforcement and Systemic Machine Learning for Decision Making focuses on the specialized research area of machine learning and systemic machine learning. It addresses reinforcement learning and its applications, incremental machine learning, repetitive failure-correction mechanisms, and multiperspective decision making.Chapters include: Introduction to Reinforcement and Systemic Machine LearningFundamentals of Whole-System, Systemic, and Multiperspective Machine LearningSystemic Machine Learning and ModelInference and Information IntegrationAdaptive LearningIncremental Learning and Knowledge RepresentationKnowledge Augmentation: A Machine Learning PerspectiveBuilding a Learning System With the potential of this paradigm to become one of the more utilized in its field, professionals in the area of machine and systemic learning will find this book to be a valuable resource.

The integration of machine learning techniques and cartoon animation research is fast becoming a hot topic. This book helps readers learn the latest machine learning techniques, including patch alignment framework; spectral clustering, graph cuts, and convex relaxation; ensemble manifold learning; multiple kernel learning; multiview subspace learning; and multiview distance metric learning. It then presents the applications of these modern machine learning techniques in cartoon animation research. With these techniques, users can efficiently utilize the cartoon materials to generate animations in areas such as virtual reality, video games, animation films, and sport simulations

Unmanned systems and robotics technologies have become very popular recently owing to their ability to replace human beings in dangerous, tedious, or repetitious jobs. This book fill the gap in the field between research and real-world applications, providing scientists and engineers with essential information on how to design and employ networked unmanned vehicles for remote sensing and distributed control purposes. Target scenarios include environmental or agricultural applications such as river/reservoir surveillance, wind profiling measurement, and monitoring/control of chemical leaks.

Enables readers to master and apply the operator-theoretic approachControl of nonlinear systems is a multidisciplinary field involving electrical engineering, computer science, and control engineering. Specifically, this book addresses uncertain nonlinearity. Beginning with how real plants are modeled as operator-based plants, the author develops a systematic methodology that enables readers to understand a quantitative stability result, a critical factor in any nonlinear control system's stability and performance.Operator-Based Nonlinear Control Systems: Design and Applications focuses on the operator-theoretic approach, offering detailed examples on how to apply it to network controlled systems. In addition to current research results, the author explores future research directions and applications of the operator-theoretic approach. The book begins with an introduction that defines nonlinear systems. Next, it covers: Robust right coprime factorization for nonlinear plants with uncertaintiesRobust stability of operator-based nonlinear control systemsTracking issues and fault detection issues in nonlinear control systemsOperator-based nonlinear control systems with smart actuatorsNonlinear feedback control for large-scale systems using a distributed control system deviceThroughout the book, discussions of actual applications help readers understand how the operator-theoretic approach works in practice.Operator-Based Nonlinear Control Systems is recommended for students and professionals in control theory engineering and applied mathematics. Working with this expertly written and organized book, they will learn how to obtain robust right coprime factorization for modeled plants. Moreover, they will discover state-of-the-technology research results on robust stability conditions as well as the latest system output tracking and fault detection issues that are challenging today's researchers.

Focuses on how to use web service computing and service-based workflow technologies to develop timely, effective workflows for both business and scientific fieldsUtilizing web computing and Service-Oriented Architecture (SOA), Business and Scientific Workflows: A Web Service–Oriented Approach focuses on how to design, analyze, and deploy web service–based workflows for both business and scientific applications in many areas of healthcare and biomedicine. It also discusses and presents the recent research and development results.This informative reference features application scenarios that include healthcare and biomedical applications, such as personalized healthcare processing, DNA sequence data processing, and electrocardiogram wave analysis, and presents: Updated research and development results on the composition technologies of web services for ever-sophisticated service requirements from various users and communitiesFundamental methods such as Petri nets and social network analysis to advance the theory and applications of workflow design and web service compositionPractical and real applications of the developed theory and methods for such platforms as personalized healthcare and Biomedical Informatics GridsThe authors' efforts on advancing service composition methods for both business and scientific software systems, with theoretical and empirical contributionsWith workflow-driven service composition and reuse being a hot topic in both academia and industry, this book is ideal for researchers, engineers, scientists, professionals, and students who work on service computing, software engineering, business and scientific workflow management, the internet, and management information systems (MIS).

Various systems science and engineering disciplines are covered and challenging new research issues in these disciplines are revealed. They will be extremely valuable for the readers to search for some new research directions and problems. Chapters are contributed by world-renowned systems engineersChapters include discussions and conclusionsReaders can grasp each event holistically without having professional expertise in the field

This book addresses the need in the field for a comprehensive review of motion planning algorithms and hybrid control methodologies for complex legged robots. Introducing a multidisciplinary systems engineering approach for tackling many challenges posed by legged locomotion, the book provides engineering detail including hybrid models for planar and 3D legged robots, as well as hybrid control schemes for asymptotically stabilizing periodic orbits in these closed-loop systems. Complete with downloadable MATLAB code of the control algorithms and schemes used in the book, this book is an invaluable guide to the latest developments and future trends in dynamical legged locomotion.

This book presents the application of system analysis techniques with case studies to help readers learn how the techniques can be applied, how the problems are solved, and which sustainable management strategies can be reached.

Most existing robust design books address design for static systems, or achieve robust design from experimental data via the Taguchi method. Little work considers model information for robust design particularly for the dynamic system. This book covers robust design for both static and dynamic systems using the nominal model information or the hybrid model/data information, and also integrates design with control under a large operating region. This design can handle strong nonlinearity and more uncertainties from model and parameters.

A comprehensive discussion of automated transit This book analyzes the successful implementations of automated transit in various international locations, such as Paris, Toronto, London, and Kuala Lumpur, and investigates the apparent lack of automated transit applications in the urban environment in the United States.The book begins with a brief definition of automated transit and its historical development. After a thorough description of the technical specifications, the author highlights a few applications from each sub-group of the automated transit spectrum. International case studies display various technologies and their applications, and identify vital factors that affect each system and performance evaluations of existing applications. The book then discusses the planning and operation of automated transit applications at both macro and micro levels. Finally, the book covers a number of less successful concepts, as well as the lessons learned, allowing readers to gain a comprehensive understanding of the topic.Key features: Provides a thorough examination of automated transit applications, their impact and implications for societyWritten by the committee chair for the Automated Transit Systems Transportation, Research BoardOffers essential information on planning, costs, and applications of automated transit systemsCovers driverless metros, automated LRT, group and personal rapid transit,  a review of worldwide applicationsIncludes capacity and safety guidelines, as well as vehicles, propulsion, and communication and control systemsThis book is essential reading for engineers, researchers, scientists, college or graduate students who work in transportation planning, engineering, operation and management fields.

This book introduces various coverage control problems for mobile sensor networks including barrier, sweep and blanket. Unlike many existing algorithms, all of the robotic sensor and actuator motion algorithms developed in the book are fully decentralized or distributed, computationally efficient, easily implementable in engineering practice and based only on information on the closest neighbours of each mobile sensor and actuator and local information about the environment. Moreover, the mobile robotic sensors have no prior information about the environment in which they operation. These various types of coverage problems have never been covered before by a single book in a systematic way. Another topic of this book is the study of mobile robotic sensor and actuator networks. Many modern engineering applications include the use of sensor and actuator networks to provide efficient and effective monitoring and control of industrial and environmental processes. Such mobile sensor and actuator networks are able to achieve improved performance and efficient monitoring together with reduction in power consumption and production cost.

Addresses the methodology and theoretical foundation of battery manufacturing, service and management systems (BM2S2), and discusses the issues and challenges in these areasThis book brings together experts in the field to highlight the cutting edge research advances in BM2S2 and to promote an innovative integrated research framework responding to the challenges. There are three major parts included in this book: manufacturing, service, and management. The first part focuses on battery manufacturing systems, including modeling, analysis, design and control, as well as economic and risk analyses.  The second part focuses on information technology’s impact on service systems, such as data-driven reliability modeling, failure prognosis, and service decision making methodologies for battery services. The third part addresses battery management systems (BMS) for control and optimization of battery cells, operations, and hybrid storage systems to ensure overall performance and safety, as well as EV management.  The contributors consist of experts from universities, industry research centers, and government agency. In addition, this book: Provides comprehensive overviews of lithium-ion battery and battery electrical vehicle manufacturing, as well as economic returns and government supportIntroduces integrated models for quality propagation and productivity improvement, as well as indicators for bottleneck identification and mitigation in battery manufacturingCovers models and diagnosis algorithms for battery SOC and SOH estimation, data-driven prognosis algorithms for predicting the remaining useful life (RUL) of battery SOC and SOHPresents mathematical models and novel structure of battery equalizers in battery management systems (BMS)Reviews the state of the art of battery, supercapacitor, and battery-supercapacitor hybrid energy storage systems (HESSs) for advanced electric vehicle applicationsAdvances in Battery Manufacturing, Services, and Management Systems is written for researchers and engineers working on battery manufacturing, service, operations, logistics, and management. It can also serve as a reference for senior undergraduate and graduate students interested in BM2S2.

A comprehensive look at state-of-the-art ADP theory and real-world applicationsThis book fills a gap in the literature by providing a theoretical framework for integrating techniques from adaptive dynamic programming (ADP) and modern nonlinear control to address data-driven optimal control design challenges arising from both parametric and dynamic uncertainties.Traditional model-based approaches leave much to be desired when addressing the challenges posed by the ever-increasing complexity of real-world engineering systems. An alternative which has received much interest in recent years are biologically-inspired approaches, primarily RADP. Despite their growing popularity worldwide, until now books on ADP have focused nearly exclusively on analysis and design, with scant consideration given to how it can be applied to address robustness issues, a new challenge arising from dynamic uncertainties encountered in common engineering problems. Robust Adaptive Dynamic Programming zeros in on the practical concerns of engineers. The authors develop RADP theory from linear systems to partially-linear, large-scale, and completely nonlinear systems. They provide in-depth coverage of state-of-the-art applications in power systems, supplemented with numerous real-world examples implemented in MATLAB. They also explore fascinating reverse engineering topics, such how ADP theory can be applied to the study of the human brain and cognition. In addition, the book:   Covers the latest developments in RADP theory and applications for solving a range of systems’ complexity problemsExplores multiple real-world implementations in power systems with illustrative examples backed up by reusable MATLAB code and Simulink block setsProvides an overview of nonlinear control, machine learning, and dynamic controlFeatures discussions of novel applications for RADP theory, including an entire chapter on how it can be used as a computational mechanism of human movement controlRobust Adaptive Dynamic Programming is both a valuable working resource and an intriguing exploration of contemporary ADP theory and applications for practicing engineers and advanced students in systems theory, control engineering, computer science, and applied mathematics.

An in-depth review of hybrid control techniques for smart prosthetic hand technology by two of the world’s pioneering experts in the fieldLong considered the stuff of science fiction, a prosthetic hand capable of fully replicating all of that appendage’s various functions is closer to becoming reality than ever before. This book provides a comprehensive report on exciting recent developments in hybrid control techniques—one of the most crucial hurdles to be overcome in creating smart prosthetic hands.Coauthored by two of the world’s foremost pioneering experts in the field, Fusion of Hard and Soft Control Strategies for Robotic Hand treats robotic hands for multiple applications. Itbegins withan overview of advances in main control techniques that have been made over the past decade before addressing the military context for affordable robotic hand technology with tactile and/or proprioceptive feedback for hand amputees. Kinematics, homogeneous transformations, inverse and differential kinematics, trajectory planning, and dynamic models of two-link thumb and three-link index finger are discussed in detail. The remainder of the book is devoted to the most promising soft computing techniques, particle swarm optimization techniques, and strategies combining hard and soft controls.In addition, the book: Includes a report on exciting new developments in prosthetic/robotic hand technology, with an emphasis on the fusion of hard and soft control strategiesCovers both prosthetic and non-prosthetic hand designs for everything from routine human operations, robotic surgery, and repair and maintenance, to hazardous materials handling, space applications, explosives disposal, and moreProvides a comprehensive overview of five-fingered robotic hand technology kinematics, dynamics, and controlFeatures detailed coverage of important recent developments in neuroprostheticsFusion of Hard and Soft Control Strategies for Robotic Hand is a must-read for researchers in control engineering, robotic engineering, biomedical sciences and engineering, and rehabilitation engineering.

An authoritative and comprehensive guide to managing energy conservation in infrastructuresEnergy Conservation in Residential, Commercial, and Industrial Facilities offers an essential guide to the business models and engineering design frameworks for the implementation of energy conservation in infrastructures. The presented models of both physical and technological systems can be applied to a wide range of structures such as homes, hotels, public facilities, industrial facilities, transportation, and water/energy supply systems. The authors—noted experts in the field—explore the key performance indicators that are used to evaluate energy conservation strategies and the energy supply scenarios as part of the design and operation of energy systems in infrastructures.The text is based on a systems approach that demonstrates the effective management of building energy knowledge and supports the simulation, evaluation, and optimization of several building energy conservation scenarios. In addition, the authors explore new methods of developing energy semantic network (ESN) superstructures, energy conservation optimization techniques, and risk-based life cycle assessments. This important text: Defines the most effective ways to model the infrastructure of physical and technological systems
Includes information on the most widely used techniques in the validation and calibration of building energy simulationOffers a discussion of the sources, quantification, and reduction of uncertaintyPresents a number of efficient energy conservation strategies in infrastructure systems, including HVAC, lighting, appliances, transportation, and industrial facilitiesDescribes illustrative case studies to demonstrate the proposed energy conservation framework, practices, methods, engineering designs, control, and technologiesWritten for students studying energy conservation as well as engineers designing the next generation of buildings, Energy Conservation in Residential, Commercial, and Industrial Facilities offers a wide-ranging guide to the effective management of energy conservation in infrastructures.

Offers an integrated presentation for path planning and motion control of cooperative mobile robots using discrete-event system principlesGenerating feasible paths or routes between a given starting position and a goal or target position—while avoiding obstacles—is a common issue for all mobile robots. This book formulates the problem of path planning of cooperative mobile robots by using the paradigm of discrete-event systems. It presents everything readers need to know about discrete event system models—mainly Finite State Automata (FSA) and Petri Nets (PN)—and methods for centralized path planning and control of teams of identical mobile robots.Path Planning of Cooperative Mobile Robots Using Discrete Event Models begins with a brief definition of the Path Planning and Motion Control problems and their state of the art. It then presents different types of discrete models such as FSA and PNs. The RMTool MATLAB toolbox is described thereafter, for readers who will need it to provide numerical experiments in the last section. The book also discusses cell decomposition approaches and shows how the divided environment can be translated into an FSA by assigning to each cell a discrete state, while the adjacent relation together with the robot's dynamics implies the discrete transitions.Highlighting the benefits of Boolean Logic, Linear Temporal Logic, cell decomposition, Finite State Automata modeling, and Petri Nets, this book also: Synthesizes automatic strategies based on Discrete Event Systems (DES) for path planning and motion control and offers software implementations for the involved algorithmsProvides a tutorial for motion planning introductory courses or related simulation-based projects using a MATLAB package called RMTool (Robot Motion Toolbox)Includes simulations for problems solved by methodologies presented in the bookPath Planning of Cooperative Mobile Robots Using Discrete Event Models is an ideal book for undergraduate and graduate students and college and university professors in the areas of robotics, artificial intelligence, systems modeling, and autonomous control.

An original, systematic-solution approach to uncertain nonlinear systems control and modeling using fuzzy equations and fuzzy differential equationsThere are various numerical and analytical approaches to the modeling and control of uncertain nonlinear systems. Fuzzy logic theory is an increasingly popular method used to solve inconvenience problems in nonlinear modeling. Modeling and Control of Uncertain Nonlinear Systems with Fuzzy Equations and Z-Number presents a structured approach to the control and modeling of uncertain nonlinear systems in industry using fuzzy equations and fuzzy differential equations.The first major work to explore methods based on neural networks and Bernstein neural networks, this innovative volume provides a framework for control and modeling of uncertain nonlinear systems with applications to industry. Readers learn how to use fuzzy techniques to solve scientific and engineering problems and understand intelligent control design and applications. The text assembles the results of four years of research on control of uncertain nonlinear systems with dual fuzzy equations, fuzzy modeling for uncertain nonlinear systems with fuzzy equations, the numerical solution of fuzzy equations with Z-numbers, and the numerical solution of fuzzy differential equations with Z-numbers. Using clear and accessible language to explain concepts and principles applicable to real-world scenarios, this book: Presents the modeling and control of uncertain nonlinear systems with fuzzy equations and fuzzy differential equationsIncludes an overview of uncertain nonlinear systems for non-specialistsTeaches readers to use simulation, modeling and verification skills valuable for scientific research and engineering systems developmentReinforces comprehension with illustrations, tables, examples, and simulationsModeling and Control of Uncertain Nonlinear Systems with Fuzzy Equations and Z-Number is suitable as a textbook for advanced students, academic and industrial researchers, and practitioners in fields of systems engineering, learning control systems, neural networks, computational intelligence, and fuzzy logic control.

Sustainable Manufacturing Systems Learn more about energy efficiency in traditional and advanced manufacturing settings with this leading and authoritative resource Sustainable Manufacturing Systems: An Energy Perspective delivers a comprehensive analysis of energy efficiency in sustainable manufacturing. The book presents manufacturing modeling methods and energy efficiency evaluation and improvement methods for different manufacturing systems. It allows industry professionals to understand the methodologies and techniques being embraced around the world that lead to advanced energy management. The book offers readers a comprehensive and systematic theoretical foundation for novel manufacturing system modeling, analysis, and control. It concludes with a summary of the insights and applications contained within and a discussion of future research issues that have yet to be grappled with. Sustainable Manufacturing Systems answers the questions that energy customers, managers, decision makers, and researchers have been asking about sustainable manufacturing. The book’s release coincides with recent and profound advances in smart grid applications and will serve as a practical tool to assist industrial engineers in furthering the green revolution. Readers will also benefit from: A thorough introduction to energy efficiency in manufacturing systems, including the current state of research and research methodologiesAn exploration of the development of manufacturing methodologies, including mathematical modeling for manufacturing systems and energy efficiency characterization in manufacturing systemsAn analysis of the applications of various methodologies, including electricity demand response for manufacturing systems and energy control and optimization for manufacturing systems utilizing combined heat and power systemsA discussion of energy efficiency in advanced manufacturing systems, like stereolithography additive manufacturing and cellulosic biofuel manufacturing systemsPerfect for researchers, undergraduate students, and graduate students in engineering disciplines, especially for those majoring in industrial, mechanical, electrical, and environmental engineering, Sustainable Manufacturing Systems will also earn a place in the libraries of management and business students interested in manufacturing system cost performance and energy management.

Presents strategies with reachability graph analysis for optimizing resource allocation systemsSupervisory Control and Scheduling of Resource Allocation Systems offers an important guide to Petri net (PN) models and methods for supervisory control and system scheduling of resource allocation systems (RASs). Resource allocation systems are common in automated manufacturing systems, project management systems, cloud data centers, and software engineering systems. The authors—two experts on the topic—present a definition, techniques, models, and state-of-the art applications of supervisory control and scheduling problems.The book introduces the basic concepts and research background on resource allocation systems and Petri nets. The authors then focus on the deadlock-free supervisor synthesis for RASs using Petri nets. The book also investigates the heuristic scheduling of RASs based on timed Petri nets. Conclusions and open problems are provided in the last section of the book. This important book: Includes multiple methods for supervisory control and scheduling with reachability graphs, and provides illustrative examplesReveals how to accelerate the supervisory controller design and system scheduling of RASs based on PN reachability graphs, with optimal or near-optimal resultsHighlights both solution quality and computational speed in RAS deadlock handling and system schedulingWritten for researchers, engineers, scientists, and professionals in system planning and control, engineering, operation, and management, Supervisory Control and Scheduling of Resource Allocation Systems provides an essential guide to the supervisory control and scheduling of resource allocation systems (RASs) using Petri net reachability graphs, which allow for multiple resource acquisitions and flexible routings.

E-CARGO and Role-Based Collaboration A model for collaboratively solving complex problems E-CARGO and Role-Based Collaboration offers a unique guide that explains the nature of collaboration, explores an easy-to-follow process of collaboration, and defines a model to solve complex problems in collaboration and complex systems. Written by a noted expert on the topic, the book initiates the study of an effective collaborative system from a novel perspective. The role-based collaboration (RBC) methodology investigates the most important aspects of a variety of collaborative systems including societal-technical systems. The models and algorithms can also be applied across system engineering, production, and management. The RBC methodology provides insights into complex systems through the use of its core model E-CARGO. The E-CARGO model provides the fundamental components, principles, relationships, and structures for specifying the state, process, and evolution of complex systems. This important book: Contains a set of concepts, models, and algorithms for the analysis, design, implementation, maintenance, and assessment of a complex systemPresents computational methods that use roles as a primary underlying mechanism to facilitate collaborative activities including role assignmentExplores the RBC methodology that concentrates on the aspects that can be handled by individuals to establish a well-formed teamOffers an authoritative book written by a noted expert on the topicWritten for researchers and practitioners dealing with complex problems in collaboration systems and technologies, E-CARGO and Role-Based Collaboration contains a model to solve real world problems with the help of computer-based systems.

Industry 4.1 Intelligent Manufacturing with Zero Defects Discover the future of manufacturing with this comprehensive introduction to Industry 4.0 technologies from a celebrated expert in the field Industry 4.1: Intelligent Manufacturing with Zero Defects delivers an in-depth exploration of the functions of intelligent manufacturing and its applications and implementations through the Intelligent Factory Automation (iFA) System Platform. The book’s distinguished editor offers readers a broad range of resources that educate and enlighten on topics as diverse as the Internet of Things, edge computing, cloud computing, and cyber-physical systems. You’ll learn about three different advanced prediction technologies: Automatic Virtual Metrology (AVM), Intelligent Yield Management (IYM), and Intelligent Predictive Maintenance (IPM). Different use cases in a variety of manufacturing industries are covered, including both high-tech and traditional areas. In addition to providing a broad view of intelligent manufacturing and covering fundamental technologies like sensors, communication standards, and container technologies, the book offers access to experimental data through the IEEE DataPort. Finally, it shows readers how to build an intelligent manufacturing platform called an Advanced Manufacturing Cloud of Things (AMCoT). Readers will also learn from: An introduction to the evolution of automation and development strategy of intelligent manufacturingA comprehensive discussion of foundational concepts in sensors, communication standards, and container technologiesAn exploration of the applications of the Internet of Things, edge computing, and cloud computingThe Intelligent Factory Automation (iFA) System Platform and its applications and implementationsA variety of use cases of intelligent manufacturing, from industries like flat-panel, semiconductor, solar cell, automotive, aerospace, chemical, and blow molding machinePerfect for researchers, engineers, scientists, professionals, and students who are interested in the ongoing evolution of Industry 4.0 and beyond, Industry 4.1: Intelligent Manufacturing with Zero Defects will also win a place in the library of laypersons interested in intelligent manufacturing applications and concepts. Completely unique, this book shows readers how Industry 4.0 technologies can be applied to achieve the goal of Zero Defects for all product

A comprehensive exploration of the control schemes of human-robot interactions In Human-Robot Interaction Control Using Reinforcement Learning, an expert team of authors delivers a concise overview of human-robot interaction control schemes and insightful presentations of novel, model-free and reinforcement learning controllers. The book begins with a brief introduction to state-of-the-art human-robot interaction control and reinforcement learning before moving on to describe the typical environment model. The authors also describe some of the most famous identification techniques for parameter estimation. Human-Robot Interaction Control Using Reinforcement Learning offers rigorous mathematical treatments and demonstrations that facilitate the understanding of control schemes and algorithms. It also describes stability and convergence analysis of human-robot interaction control and reinforcement learning based control. The authors also discuss advanced and cutting-edge topics, like inverse and velocity kinematics solutions, H2 neural control, and likely upcoming developments in the field of robotics. Readers will also enjoy:   A thorough introduction to model-based human-robot interaction control Comprehensive explorations of model-free human-robot interaction control and human-in-the-loop control using Euler angles Practical discussions of reinforcement learning for robot position and force control, as well as continuous time reinforcement learning for robot force control In-depth examinations of robot control in worst-case uncertainty using reinforcement learning and the control of redundant robots using multi-agent reinforcement learning  Perfect for senior undergraduate and graduate students, academic researchers, and industrial practitioners studying and working in the fields of robotics, learning control systems, neural networks, and computational intelligence, Human-Robot Interaction Control Using Reinforcement Learning is also an indispensable resource for students and professionals studying reinforcement learning.

Infrastructure Robotics Illuminating resource presenting commonly used robotic methodologies and technologies, with recent developments and clear application examples across different project types Infrastructure Robotics presents state-of-the-art research in infrastructure robotics and key methodologies that enable the development of intelligent robots for operation in civil infrastructure environments, describing sensing, perception, localization, map building, environmental and operation awareness, motion and task planning, design methodologies, robot assistance paradigms, and physical human-robot collaboration. The text also presents many case studies of robotic systems developed for real-world applications in maintaining various civil infrastructures, including steel bridges, tunnels, underground water mains, underwater structures, and sewer pipes. In addition, later chapters discuss lessons learned in deployment of intelligent robots in practical applications overall. Infrastructure Robotics provides a timely and thorough treatment of the subject pertaining to recent developments, such as computer vision and machine learning techniques that have been used in inspection and condition assessment of critical civil infrastructures, including bridges, tunnels, and more. Written by highly qualified contributors with significant experience in both academia and industry, Infrastructure Robotics covers topics such as: Design methods for application of robots in civil infrastructure inspired by biological systems including ants, inchworms, and humansFundamental aspects of research on intelligent robotic co-workers for human-robot collaborative operationsThe ROBO-SPECT European project and a robotized alternative to manual tunnel structural inspection and assessmentWider context for the use of additive manufacturing techniques on construction sitesInfrastructure Robotics is an essential resource for researchers, engineers, and graduate students in related fields. Professionals in civil engineering, asset management, and project management who wish to be on the cutting edge of the future of their industries will also benefit from the text.