Hitoshi Iba - Böcker

This book provides theoretical and practical knowledge on AI and swarm intelligence. It provides a methodology for EA (evolutionary algorithm)-based approach for complex adaptive systems with the integration of several meta-heuristics, e.g., ACO (Ant Colony Optimization), ABC (Artificial Bee Colony), and PSO (Particle Swarm Optimization), etc. These developments contribute towards better problem-solving methodologies in AI. The book also covers emerging uses of swarm intelligence in applications such as complex adaptive systems, reaction-diffusion computing, and diffusion-limited aggregation, etc.Another emphasis is its real-world applications. We give empirical examples from real-world problems and show that the proposed approaches are successful when addressing tasks from such areas as swarm robotics, silicon traffics, image understanding, Vornoi diagrams, queuing theory, and slime intelligence, etc. Each chapter begins with the background of the problem followed by the current state-of-the-art techniques of the field, and ends with a detailed discussion. In addition, the simulators, based on optimizers such as PSO and ABC complex adaptive system simulation, are described in detail. These simulators, as well as some source codes, are available online on the author’s website for the benefit of readers interested in getting some hands-on experience of the subject.The concepts presented in this book aim to promote and facilitate the effective research in swarm intelligence approaches in both theory and practice. This book would also be of value to other readers because it covers interdisciplinary research topics that encompass problem-solving tasks in AI, complex adaptive systems, and meta-heuristics.

What do financial data prediction, day-trading rule development, and bio-marker selection have in common? They are just a few of the tasks that could potentially be resolved with genetic programming and machine learning techniques. Written by leaders in this field, Applied Genetic Programming and Machine Learning delineates the extension of Genetic Programming (GP) for practical applications. Reflecting rapidly developing concepts and emerging paradigms, this book outlines how to use machine learning techniques, make learning operators that efficiently sample a search space, navigate the search process through the design of objective fitness functions, and examine the search performance of the evolutionary system. It provides a methodology for integrating GP and machine learning techniques, establishing a robust evolutionary framework for addressing tasks from areas such as chaotic time-series prediction, system identification, financial forecasting, classification, and data mining. The book provides a starting point for the research of extended GP frameworks with the integration of several machine learning schemes. Drawing on empirical studies taken from fields such as system identification, finanical engineering, and bio-informatics, it demonstrates how the proposed methodology can be useful in practical inductive problem solving.

This book provides theoretical and practical knowledge on AI and swarm intelligence. It provides a methodology for EA (evolutionary algorithm)-based approach for complex adaptive systems with the integration of several meta-heuristics, e.g., ACO (Ant Colony Optimization), ABC (Artificial Bee Colony), and PSO (Particle Swarm Optimization), etc. These developments contribute towards better problem-solving methodologies in AI. The book also covers emerging uses of swarm intelligence in applications such as complex adaptive systems, reaction-diffusion computing, and diffusion-limited aggregation, etc.Another emphasis is its real-world applications. We give empirical examples from real-world problems and show that the proposed approaches are successful when addressing tasks from such areas as swarm robotics, silicon traffics, image understanding, Vornoi diagrams, queuing theory, and slime intelligence, etc. Each chapter begins with the background of the problem followed by the current state-of-the-art techniques of the field, and ends with a detailed discussion. In addition, the simulators, based on optimizers such as PSO and ABC complex adaptive system simulation, are described in detail. These simulators, as well as some source codes, are available online on the author’s website for the benefit of readers interested in getting some hands-on experience of the subject.The concepts presented in this book aim to promote and facilitate the effective research in swarm intelligence approaches in both theory and practice. This book would also be of value to other readers because it covers interdisciplinary research topics that encompass problem-solving tasks in AI, complex adaptive systems, and meta-heuristics.

This book provides theoretical and practical knowledge for develop­ ment of algorithms that infer linear and nonlinear models. It offers a methodology for inductive learning of polynomial neural network mod­ els from data. The design of such tools contributes to better statistical data modelling when addressing tasks from various areas like system identification, chaotic time-series prediction, financial forecasting and data mining. The main claim is that the model identification process involves several equally important steps: finding the model structure, estimating the model weight parameters, and tuning these weights with respect to the adopted assumptions about the underlying data distrib­ ution. When the learning process is organized according to these steps, performed together one after the other or separately, one may expect to discover models that generalize well (that is, predict well). The book off'ers statisticians a shift in focus from the standard f- ear models toward highly nonlinear models that can be found by con­ temporary learning approaches. Speciafists in statistical learning will read about alternative probabilistic search algorithms that discover the model architecture, and neural network training techniques that identify accurate polynomial weights. They wfil be pleased to find out that the discovered models can be easily interpreted, and these models assume statistical diagnosis by standard statistical means. Covering the three fields of: evolutionary computation, neural net­ works and Bayesian inference, orients the book to a large audience of researchers and practitioners.

The book provides theoretical and practical knowledge about swarm intelligence and evolutionary computation. It describes the emerging trends in deep learning that involve the integration of swarm intelligence and evolutionary computation with deep learning, i.e., deep neuroevolution and deep swarms. The study reviews the research on network structures and hyperparameters in deep learning, and attracting attention as a new trend in AI. A part of the coverage of the book is based on the results of practical examples as well as various real-world applications. The future of AI, based on the ideas of swarm intelligence and evolution is also covered.The book is an introductory work for researchers. Approaches to the realization of AI and the emergence of intelligence are explained, with emphasis on evolution and learning. It is designed for beginners who do not have any knowledge of algorithms or biology, and explains the basics of neural networks and deep learning in an easy-to-understand manner. As a practical exercise in neuroevolution, the book shows how to learn to drive a racing car and a helicopter using MindRender. MindRender is an AI educational software that allows the readers to create and play with VR programs, and provides a variety of examples so that the readers will be able to create and understand AI.

The book provides theoretical and practical knowledge about swarm intelligence and evolutionary computation. It describes the emerging trends in deep learning that involve the integration of swarm intelligence and evolutionary computation with deep learning, i.e., deep neuroevolution and deep swarms. The study reviews the research on network structures and hyperparameters in deep learning, and attracting attention as a new trend in AI. A part of the coverage of the book is based on the results of practical examples as well as various real-world applications. The future of AI, based on the ideas of swarm intelligence and evolution is also covered.The book is an introductory work for researchers. Approaches to the realization of AI and the emergence of intelligence are explained, with emphasis on evolution and learning. It is designed for beginners who do not have any knowledge of algorithms or biology, and explains the basics of neural networks and deep learning in an easy-to-understand manner. As a practical exercise in neuroevolution, the book shows how to learn to drive a racing car and a helicopter using MindRender. MindRender is an AI educational software that allows the readers to create and play with VR programs, and provides a variety of examples so that the readers will be able to create and understand AI.

This book provides theoretical and practical knowledge about swarm and evolutionary approach of generative AI and Large Language Models (LLMs). The development of such tools contributes to better optimizing methodologies with the integration of several machinelearning and deep learning techniques. In particular, it discusses how the “emergence” concept can contribute to the improvement of AI.The book aims to model human cognitive f unction in terms of “emergence” and to explain the feasibility of AI. To this end, it focuses on human perceptions of “utility.” It describes the emergence of various cognitive errors, and irrational behaviours in the multiobjective situations. It also reviews the cognitive differences and similarities between humans and LLMs. Such studies are important when applying LLMs to real-world tasks that involve human cognition, e.g., financial engineering and market issues.The book describes the intelligent behaviour of living organisms. This is to clarify how to achieve AI in the direction of artificial life. It describes sexual selection, which is a well-known natural phenomenon that troubled Darwin, i.e., why evolutionarily useless items evolved such as peacock feathers and moose antlers etc. The book shows how sexual selection is extended as “novelty search” for the application of generative AI, i.e., the image generation with diffusion model. Real-world applications are emphasised. Empirical examples from real-world data show how the concept of deep swarm and evolution is successfully applied when addressing tasks from such recent fields as robotics, e-commerce Web Shop and image generation etc.

Introducing a handbook for gene regulatory network research using evolutionary computation, with applications for computer scientists, computational and system biologistsThis book is a step-by-step guideline for research in gene regulatory networks (GRN) using evolutionary computation (EC). The book is organized into four parts that deliver materials in a way equally attractive for a reader with training in computation or biology. Each of these sections, authored by well-known researchers and experienced practitioners, provides the relevant materials for the interested readers. The first part of this book contains an introductory background to the field. The second part presents the EC approaches for analysis and reconstruction of GRN from gene expression data. The third part of this book covers the contemporary advancements in the automatic construction of gene regulatory and reaction networks and gives direction and guidelines for future research. Finally, the last part of this book focuses on applications of GRNs with EC in other fields, such as design, engineering and robotics.• Provides a reference for current and future research in gene regulatory networks (GRN) using evolutionary computation (EC)• Covers sub-domains of GRN research using EC, such as expression profile analysis, reverse engineering, GRN evolution, applications• Contains useful contents for courses in gene regulatory networks, systems biology, computational biology, and synthetic biology• Delivers state-of-the-art research in genetic algorithms, genetic programming, and swarm intelligenceEvolutionary Computation in Gene Regulatory Network Research is a reference for researchers and professionals in computer science, systems biology, and bioinformatics, as well as upper undergraduate, graduate, and postgraduate students.Hitoshi Iba is a Professor in the Department of Information and Communication Engineering, Graduate School of Information Science and Technology, at the University of Tokyo, Toyko, Japan. He is an Associate Editor of the IEEE Transactions on Evolutionary Computation and the journal of Genetic Programming and Evolvable Machines. Nasimul Noman is a lecturer in the School of Electrical Engineering and Computer Science at the University of Newcastle, NSW, Australia. From 2002 to 2012 he was a faculty member at the University of Dhaka, Bangladesh. Noman is an Editor of the BioMed Research International journal. His research interests include computational biology, synthetic biology, and bioinformatics.

Swarm-based multi-agent simulation leads to better modeling of tasks in biology, engineering, economics, art, and many other areas. It also facilitates an understanding of complicated phenomena that cannot be solved analytically. Agent-Based Modeling and Simulation with Swarm provides the methodology for a multi-agent-based modeling approach that integrates computational techniques such as artificial life, cellular automata, and bio-inspired optimization.Each chapter gives an overview of the problem, explores state-of-the-art technology in the field, and discusses multi-agent frameworks. The author describes step by step how to assemble algorithms for generating a simulation model, program, method for visualization, and further research tasks. While the book employs the commonly used Swarm system, readers can model and develop the simulations with their own simulator. To encourage hands-on exploration of emergent systems, Swarm-based software and source codes are available for download from the author’s website. A thorough overview of multi-agent simulation and supporting tools, this book shows how this type of simulation is used to acquire an understanding of complex systems and artificial life. It carefully explains how to construct a simulation program for various applications.

What do financial data prediction, day-trading rule development, and bio-marker selection have in common? They are just a few of the tasks that could potentially be resolved with genetic programming and machine learning techniques. Written by leaders in this field, Applied Genetic Programming and Machine Learning delineates the extension of Genetic Programming (GP) for practical applications. Reflecting rapidly developing concepts and emerging paradigms, this book outlines how to use machine learning techniques, make learning operators that efficiently sample a search space, navigate the search process through the design of objective fitness functions, and examine the search performance of the evolutionary system. It provides a methodology for integrating GP and machine learning techniques, establishing a robust evolutionary framework for addressing tasks from areas such as chaotic time-series prediction, system identification, financial forecasting, classification, and data mining. The book provides a starting point for the research of extended GP frameworks with the integration of several machine learning schemes. Drawing on empirical studies taken from fields such as system identification, finanical engineering, and bio-informatics, it demonstrates how the proposed methodology can be useful in practical inductive problem solving.

This book provides theoretical and practical knowledge for develop­ ment of algorithms that infer linear and nonlinear models. It offers a methodology for inductive learning of polynomial neural network mod­ els from data. The design of such tools contributes to better statistical data modelling when addressing tasks from various areas like system identification, chaotic time-series prediction, financial forecasting and data mining. The main claim is that the model identification process involves several equally important steps: finding the model structure, estimating the model weight parameters, and tuning these weights with respect to the adopted assumptions about the underlying data distrib­ ution. When the learning process is organized according to these steps, performed together one after the other or separately, one may expect to discover models that generalize well (that is, predict well). The book off'ers statisticians a shift in focus from the standard f- ear models toward highly nonlinear models that can be found by con­ temporary learning approaches. Speciafists in statistical learning will read about alternative probabilistic search algorithms that discover the model architecture, and neural network training techniques that identify accurate polynomial weights. They wfil be pleased to find out that the discovered models can be easily interpreted, and these models assume statistical diagnosis by standard statistical means. Covering the three fields of: evolutionary computation, neural net­ works and Bayesian inference, orients the book to a large audience of researchers and practitioners.

Swarm-based multi-agent simulation leads to better modeling of tasks in biology, engineering, economics, art, and many other areas. It also facilitates an understanding of complicated phenomena that cannot be solved analytically. Agent-Based Modeling and Simulation with Swarm provides the methodology for a multi-agent-based modeling approach that integrates computational techniques such as artificial life, cellular automata, and bio-inspired optimization.Each chapter gives an overview of the problem, explores state-of-the-art technology in the field, and discusses multi-agent frameworks. The author describes step by step how to assemble algorithms for generating a simulation model, program, method for visualization, and further research tasks. While the book employs the commonly used Swarm system, readers can model and develop the simulations with their own simulator. To encourage hands-on exploration of emergent systems, Swarm-based software and source codes are available for download from the author’s website. A thorough overview of multi-agent simulation and supporting tools, this book shows how this type of simulation is used to acquire an understanding of complex systems and artificial life. It carefully explains how to construct a simulation program for various applications.

This book delivers theoretical and practical knowledge of Genetic Algorithms (GA) for the purpose of practical applications. It provides a methodology for a GA-based search strategy with the integration of several Artificial Life and Artificial Intelligence techniques, such as memetic concepts, swarm intelligence, and foraging strategies. The development of such tools contributes to better optimizing methodologies when addressing tasks from areas such as robotics, financial forecasting, and data mining in bioinformatics.The emphasis of this book is on applicability to the real world. Tasks from application areas - optimization of the trading rule in foreign exchange (FX) and stock prices, economic load dispatch in power system, exit/door placement for evacuation planning, and gene regulatory network inference in bioinformatics - are studied, and the resultant empirical investigations demonstrate how successful the proposed approaches are when solving real-world tasks of great importance.

“Practical Applications of Evolutionary Computation to Financial Engineering” presents the state of the art techniques in Financial Engineering using recent results in Machine Learning and Evolutionary Computation. This book bridges the gap between academics in computer science and traders and explains the basic ideas of the proposed systems and the financial problems in ways that can be understood by readers without previous knowledge on either of the fields. To cement the ideas discussed in the book, software packages are offered that implement the systems described within. The book is structured so that each chapter can be read independently from the others. Chapters 1 and 2 describe evolutionary computation. The third chapter is an introduction to financial engineering problems for readers who are unfamiliar with this area. The following chapters each deal, in turn, with a different problem in the financial engineering field describing each problem in detail and focusing on solutions based on evolutionary computation. Finally, the two appendixes describe software packages that implement the solutions discussed in this book, including installation manuals and parameter explanations.

“Practical Applications of Evolutionary Computation to Financial Engineering” presents the state of the art techniques in Financial Engineering using recent results in Machine Learning and Evolutionary Computation.

This book provides theoretical and practical knowledge about a methodology for evolutionary algorithm-based search strategy with the integration of several machine learning and deep learning techniques. These include convolutional neural networks, Gröbner bases, relevance vector machines, transfer learning, bagging and boosting methods, clustering techniques (affinity propagation), and belief networks, among others. The development of such tools contributes to better optimizing methodologies. Beginning with the essentials of evolutionary algorithms and covering interdisciplinary research topics, the contents of this book are valuable for different classes of readers: novice, intermediate, and also expert readers from related fields.Following the chapters on introduction and basic methods, Chapter 3 details a new research direction, i.e., neuro-evolution, an evolutionary method for the generation of deep neural networks, and also describes how evolutionary methods are extended in combination with machine learning techniques. Chapter 4 includes novel methods such as particle swarm optimization based on affinity propagation (PSOAP), and transfer learning for differential evolution (TRADE), another machine learning approach for extending differential evolution.The last chapter is dedicated to the state of the art in gene regulatory network (GRN) research as one of the most interesting and active research fields. The author describes an evolving reaction network, which expands the neuro-evolution methodology to produce a type of genetic network suitable for biochemical systems and has succeeded in designing genetic circuits in synthetic biology. The author also presents real-world GRN application to several artificial intelligent tasks, proposing a framework of motion generation by GRNs (MONGERN), which evolves GRNs to operate a real humanoid robot.

This book provides theoretical and practical knowledge about a methodology for evolutionary algorithm-based search strategy with the integration of several machine learning and deep learning techniques. These include convolutional neural networks, Gröbner bases, relevance vector machines, transfer learning, bagging and boosting methods, clustering techniques (affinity propagation), and belief networks, among others. The development of such tools contributes to better optimizing methodologies. Beginning with the essentials of evolutionary algorithms and covering interdisciplinary research topics, the contents of this book are valuable for different classes of readers: novice, intermediate, and also expert readers from related fields.Following the chapters on introduction and basic methods, Chapter 3 details a new research direction, i.e., neuro-evolution, an evolutionary method for the generation of deep neural networks, and also describes how evolutionary methods are extended in combination with machine learning techniques. Chapter 4 includes novel methods such as particle swarm optimization based on affinity propagation (PSOAP), and transfer learning for differential evolution (TRADE), another machine learning approach for extending differential evolution.The last chapter is dedicated to the state of the art in gene regulatory network (GRN) research as one of the most interesting and active research fields. The author describes an evolving reaction network, which expands the neuro-evolution methodology to produce a type of genetic network suitable for biochemical systems and has succeeded in designing genetic circuits in synthetic biology. The author also presents real-world GRN application to several artificial intelligent tasks, proposing a framework of motion generation by GRNs (MONGERN), which evolves GRNs to operate a real humanoid robot.

Consequently, EC researchers are enthusiastic about applying their arsenal for the design and optimization of deep neural networks (DNN). This book brings together the recent progress in DL research where the focus is particularly on three sub-domains that integrate EC with DL: (1) EC for hyper-parameter optimization in DNN;

Consequently, EC researchers are enthusiastic about applying their arsenal for the design and optimization of deep neural networks (DNN). This book brings together the recent progress in DL research where the focus is particularly on three sub-domains that integrate EC with DL: (1) EC for hyper-parameter optimization in DNN;