Distributed and Cloud Computing: From Parallel Processing to the Internet of Things offers complete coverage of modern distributed computing technology including clusters, the grid, service-oriented architecture, massively parallel processors, peer-to-peer networking, and cloud computing. It is the first modern, up-to-date distributed systems textbook; it explains how to create high-performance, scalable, reliable systems, exposing the design principles, architecture, and innovative applications of parallel, distributed, and cloud computing systems.

Topics covered by this book include: facilitating management, debugging, migration, and disaster recovery through virtualization; clustered systems for research or ecommerce applications; designing systems as web services; and social networking systems using peer-to-peer computing. The principles of cloud computing are discussed using examples from open-source and commercial applications, along with case studies from the leading distributed computing vendors such as Amazon, Microsoft, and Google. Each chapter includes exercises and further reading, with lecture slides and more available online.

This book will be ideal for students taking a distributed systems or distributed computing class, as well as for professional system designers and engineers looking for a reference to the latest distributed technologies including cloud, P2P and grid computing.

An analytical overview of the state of the art, open problems, and future trends in heterogeneous parallel and distributed computing

This book provides an overview of the ongoing academic research, development, and uses of heterogeneous parallel and distributed computing in the context of scientific computing. Presenting the state of the art in this challenging and rapidly evolving area, the book is organized in five distinct parts:

High Performance Heterogeneous Computing is a valuable¿reference for researchers and practitioners in the area of high performance heterogeneous computing. It also serves as an excellent supplemental text for graduate and postgraduate courses in related areas.

Parallel Computing is a compelling vision of how computation can seamlessly scale from a single processor to virtually limitless computing power. Unfortunately, the scaling of application performance has not matched peak speed, and the programming burden for these machines remains heavy. The applications must be programmed to exploit parallelism in the most efficient way possible. Today, the responsibility for achieving the vision of scalable parallelism remains in the hands of the application developer.

This book represents the collected knowledge and experience of over 60 leading parallel computing researchers. They offer students, scientists and engineers a complete sourcebook with solid coverage of parallel computing hardware, programming considerations, algorithms, software and enabling technologies, as well as several parallel application case studies. The Sourcebook of Parallel Computing offers extensive tutorials and detailed documentation of the advanced strategies produced by research over the last two decades application case studies. The Sourcebook of Parallel Computing offers extensive tutorials and detailed documentation of the advanced strategies produced by research over the last two decades* Provides a solid background in parallel computing technologies* Examines the technologies available and teaches students and practitioners how to select and apply them* Presents case studies in a range of application areas including Chemistry, Image Processing, Data Mining, Ocean Modeling and Earthquake Simulation* Considers the future development of parallel computing technologies and the kinds of applications they will support

The 91 regular papers presented in these volumes were selected from 161 submissions. For regular tracks of the conference, 41 papers were selected from 89 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; emerging HPC architectures; performance analysis and scheduling in HPC systems; environments and frameworks for parallel/distributed/cloud computing; applications of parallel computing; parallel non-numerical algorithms; soft computing with applications; special session on GPU computing; special session on parallel matrix factorizations.

Part II: workshop on language-based parallel programming models (WLPP 2019); workshop on models algorithms and methodologies for hybrid parallelism in new HPC systems; workshop on power and energy aspects of computations (PEAC 2019); special session on tools for energy efficient computing; workshop on scheduling for parallel computing (SPC 2019); workshop on applied high performance numerical algorithms for PDEs; minisymposium on HPC applications in physical sciences; minisymposium on high performance computing interval methods; workshop on complex collective systems.

The 91 regular papers presented in these volumes were selected from 161 submissions. For regular tracks of the conference, 41 papers were selected from 89 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; emerging HPC architectures; performance analysis and scheduling in HPC systems; environments and frameworks for parallel/distributed/cloud computing; applications of parallel computing; parallel non-numerical algorithms; soft computing with applications; special session on GPU computing; special session on parallel matrix factorizations.

Part II: workshop on language-based parallel programming models (WLPP 2019); workshop on models algorithms and methodologies for hybrid parallelism in new HPC systems; workshop on power and energy aspects of computations (PEAC 2019); special session on tools for energy efficient computing; workshop on scheduling for parallel computing (SPC 2019); workshop on applied high performance numerical algorithms for PDEs; minisymposium on HPC applications in physical sciences; minisymposium on high performance computing interval methods; workshop on complex collective systems.

The 77 regular papers presented in these volumes were selected from 132 submissions. For regular tracks of the conference, 33 papers were selected from 62 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; parallel non-numerical algorithms; GPU computing; performance analysis and prediction in HPC systems; scheduling for parallel computing; environments and frameworks for parallel/cloud computing; applications of parallel and distributed computing; soft computing with applications and special session on parallel EVD/SVD and its application in matrix computations.

Part II: 9th Workshop on Language-Based Parallel Programming (WLPP 2022); 6th Workshop on Models, Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2022); first workshop on quantum computing and communication; First Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing (WAML 2022); 4th workshop on applied high performance numerical algorithms for PDEs; 5th minisymposium on HPC applications in physical sciences; 8th minisymposium on high performance computing interval methods; 7th workshop on complex collective systems.

This two-volume set, LNCS 13826 and LNCS 13827, constitutes the proceedings of the 14th International Conference on Parallel Processing and Applied Mathematics, PPAM 2022, held in Gdansk, Poland, in September 2022.

The 77 regular papers presented in these volumes were selected from 132 submissions. For regular tracks of the conference, 33 papers were selected from 62 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; parallel non-numerical algorithms; GPU computing; performance analysis and prediction in HPC systems; scheduling for parallel computing; environments and frameworks for parallel/cloud computing; applications of parallel and distributed computing; soft computing with applications and special session on parallel EVD/SVD and its application in matrix computations.

Part II: 9th Workshop on Language-Based Parallel Programming (WLPP 2022); 6th Workshop on Models,Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2022); first workshop on quantum computing and communication; First Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing (WAML 2022); 4th workshop on applied high performance numerical algorithms for PDEs; 5th minisymposium on HPC applications in physical sciences; 8th minisymposium on high performance computing interval methods; 7th workshop on complex collective systems.

This book constitutes the refereed post proceedings of the 18th International Conference on Parallel Computational Technologies, PCT 2024, held in Chelyabinsk, Russia, in April 2024.

The 22 full papers included in this book were carefully reviewed and selected from 62 submissions. These papers have been organized under the following topical sections: High Performance Architectures, Tools and Technologies; Parallel Numerical Algorithms and Supercomputer Simulation.

This book constitutes the refereed proceedings of the 15th International Conference on Parallel Processing and Applied Mathematics, PPAM 2024, held in Ostrava, Czech Republic, during September 8–11, 2024.

The 75 full papers included in this book were carefully reviewed and selected from 134 submissions. . The papers are organized in the following topical sections:

Part I : Numerical Algorithms and Parallel Scientific Computing; Architectural Aspects of HPC; Parallel Non-numerical Algorithms; GPU Computing; Performance Analysis and Prediction in HPCSystems; Environments and Frameworks for Parallel/Cloud/Edge Computing; and Applications of Parallel and Distributed Computing.

Part II : First PPAM Workshop on RISC-V (RISC-V PPAM 2024); Special Session on Scheduling for Parallel Computing; 10th Workshop on Language-Based Parallel Programming (WLPP 2024); 7th Workshop on Models Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2024); and Second Workshop on Quantum Computing and Communication.

Part III : First Workshop on Advancements of Global Challenges Application; Second Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing; 5th Workshop on Applied High Performance Numerical Algorithms for PDEs; Special Session on Parallel EVD/SVD and its Application in Matrix Computations; 6th Minisymposium on HPC Applications in Physical Sciences; and 8th Workshop on Complex Collective Systems.

This book constitutes the refereed proceedings of the 15th International Conference on Parallel Processing and Applied Mathematics, PPAM 2024, held in Ostrava, Czech Republic, during September 8–11, 2024.

The 75 full papers included in this book were carefully reviewed and selected from 134 submissions. . The papers are organized in the following topical sections:

Part I : Numerical Algorithms and Parallel Scientific Computing; Architectural Aspects of HPC; Parallel Non-numerical Algorithms; GPU Computing; Performance Analysis and Prediction in HPCSystems; Environments and Frameworks for Parallel/Cloud/Edge Computing; and Applications of Parallel and Distributed Computing.

Part II : First PPAM Workshop on RISC-V (RISC-V PPAM 2024); Special Session on Scheduling for Parallel Computing; 10th Workshop on Language-Based Parallel Programming (WLPP 2024); 7th Workshop on Models Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2024); and Second Workshop on Quantum Computing and Communication.

Part III : First Workshop on Advancements of Global Challenges Application; Second Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing; 5th Workshop on Applied High Performance Numerical Algorithms for PDEs; Special Session on Parallel EVD/SVD and its Application in Matrix Computations; 6th Minisymposium on HPC Applications in PhysicalSciences; and 8th Workshop on Complex Collective Systems.

Distributed and Cloud Computing: From Parallel Processing to the Internet of Things offers complete coverage of modern distributed computing technology including clusters, the grid, service-oriented architecture, massively parallel processors, peer-to-peer networking, and cloud computing. It is the first modern, up-to-date distributed systems textbook; it explains how to create high-performance, scalable, reliable systems, exposing the design principles, architecture, and innovative applications of parallel, distributed, and cloud computing systems.

Topics covered by this book include: facilitating management, debugging, migration, and disaster recovery through virtualization; clustered systems for research or ecommerce applications; designing systems as web services; and social networking systems using peer-to-peer computing. The principles of cloud computing are discussed using examples from open-source and commercial applications, along with case studies from the leading distributed computing vendors such as Amazon, Microsoft, and Google. Each chapter includes exercises and further reading, with lecture slides and more available online.

This book will be ideal for students taking a distributed systems or distributed computing class, as well as for professional system designers and engineers looking for a reference to the latest distributed technologies including cloud, P2P and grid computing.

An analytical overview of the state of the art, open problems, and future trends in heterogeneous parallel and distributed computing

This book provides an overview of the ongoing academic research, development, and uses of heterogeneous parallel and distributed computing in the context of scientific computing. Presenting the state of the art in this challenging and rapidly evolving area, the book is organized in five distinct parts:

High Performance Heterogeneous Computing is a valuable¿reference for researchers and practitioners in the area of high performance heterogeneous computing. It also serves as an excellent supplemental text for graduate and postgraduate courses in related areas.

Parallel Computing is a compelling vision of how computation can seamlessly scale from a single processor to virtually limitless computing power. Unfortunately, the scaling of application performance has not matched peak speed, and the programming burden for these machines remains heavy. The applications must be programmed to exploit parallelism in the most efficient way possible. Today, the responsibility for achieving the vision of scalable parallelism remains in the hands of the application developer.

This book represents the collected knowledge and experience of over 60 leading parallel computing researchers. They offer students, scientists and engineers a complete sourcebook with solid coverage of parallel computing hardware, programming considerations, algorithms, software and enabling technologies, as well as several parallel application case studies. The Sourcebook of Parallel Computing offers extensive tutorials and detailed documentation of the advanced strategies produced by research over the last two decades application case studies. The Sourcebook of Parallel Computing offers extensive tutorials and detailed documentation of the advanced strategies produced by research over the last two decades* Provides a solid background in parallel computing technologies* Examines the technologies available and teaches students and practitioners how to select and apply them* Presents case studies in a range of application areas including Chemistry, Image Processing, Data Mining, Ocean Modeling and Earthquake Simulation* Considers the future development of parallel computing technologies and the kinds of applications they will support

The 91 regular papers presented in these volumes were selected from 161 submissions. For regular tracks of the conference, 41 papers were selected from 89 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; emerging HPC architectures; performance analysis and scheduling in HPC systems; environments and frameworks for parallel/distributed/cloud computing; applications of parallel computing; parallel non-numerical algorithms; soft computing with applications; special session on GPU computing; special session on parallel matrix factorizations.

Part II: workshop on language-based parallel programming models (WLPP 2019); workshop on models algorithms and methodologies for hybrid parallelism in new HPC systems; workshop on power and energy aspects of computations (PEAC 2019); special session on tools for energy efficient computing; workshop on scheduling for parallel computing (SPC 2019); workshop on applied high performance numerical algorithms for PDEs; minisymposium on HPC applications in physical sciences; minisymposium on high performance computing interval methods; workshop on complex collective systems.

The 91 regular papers presented in these volumes were selected from 161 submissions. For regular tracks of the conference, 41 papers were selected from 89 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; emerging HPC architectures; performance analysis and scheduling in HPC systems; environments and frameworks for parallel/distributed/cloud computing; applications of parallel computing; parallel non-numerical algorithms; soft computing with applications; special session on GPU computing; special session on parallel matrix factorizations.

Part II: workshop on language-based parallel programming models (WLPP 2019); workshop on models algorithms and methodologies for hybrid parallelism in new HPC systems; workshop on power and energy aspects of computations (PEAC 2019); special session on tools for energy efficient computing; workshop on scheduling for parallel computing (SPC 2019); workshop on applied high performance numerical algorithms for PDEs; minisymposium on HPC applications in physical sciences; minisymposium on high performance computing interval methods; workshop on complex collective systems.

The 77 regular papers presented in these volumes were selected from 132 submissions. For regular tracks of the conference, 33 papers were selected from 62 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; parallel non-numerical algorithms; GPU computing; performance analysis and prediction in HPC systems; scheduling for parallel computing; environments and frameworks for parallel/cloud computing; applications of parallel and distributed computing; soft computing with applications and special session on parallel EVD/SVD and its application in matrix computations.

Part II: 9th Workshop on Language-Based Parallel Programming (WLPP 2022); 6th Workshop on Models, Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2022); first workshop on quantum computing and communication; First Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing (WAML 2022); 4th workshop on applied high performance numerical algorithms for PDEs; 5th minisymposium on HPC applications in physical sciences; 8th minisymposium on high performance computing interval methods; 7th workshop on complex collective systems.

This two-volume set, LNCS 13826 and LNCS 13827, constitutes the proceedings of the 14th International Conference on Parallel Processing and Applied Mathematics, PPAM 2022, held in Gdansk, Poland, in September 2022.

The 77 regular papers presented in these volumes were selected from 132 submissions. For regular tracks of the conference, 33 papers were selected from 62 submissions.

The papers were organized in topical sections named as follows:

Part I: numerical algorithms and parallel scientific computing; parallel non-numerical algorithms; GPU computing; performance analysis and prediction in HPC systems; scheduling for parallel computing; environments and frameworks for parallel/cloud computing; applications of parallel and distributed computing; soft computing with applications and special session on parallel EVD/SVD and its application in matrix computations.

Part II: 9th Workshop on Language-Based Parallel Programming (WLPP 2022); 6th Workshop on Models,Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2022); first workshop on quantum computing and communication; First Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing (WAML 2022); 4th workshop on applied high performance numerical algorithms for PDEs; 5th minisymposium on HPC applications in physical sciences; 8th minisymposium on high performance computing interval methods; 7th workshop on complex collective systems.

This book constitutes the refereed post proceedings of the 18th International Conference on Parallel Computational Technologies, PCT 2024, held in Chelyabinsk, Russia, in April 2024.

The 22 full papers included in this book were carefully reviewed and selected from 62 submissions. These papers have been organized under the following topical sections: High Performance Architectures, Tools and Technologies; Parallel Numerical Algorithms and Supercomputer Simulation.

This book constitutes the refereed proceedings of the 15th International Conference on Parallel Processing and Applied Mathematics, PPAM 2024, held in Ostrava, Czech Republic, during September 8–11, 2024.

The 75 full papers included in this book were carefully reviewed and selected from 134 submissions. . The papers are organized in the following topical sections:

Part I : Numerical Algorithms and Parallel Scientific Computing; Architectural Aspects of HPC; Parallel Non-numerical Algorithms; GPU Computing; Performance Analysis and Prediction in HPCSystems; Environments and Frameworks for Parallel/Cloud/Edge Computing; and Applications of Parallel and Distributed Computing.

Part II : First PPAM Workshop on RISC-V (RISC-V PPAM 2024); Special Session on Scheduling for Parallel Computing; 10th Workshop on Language-Based Parallel Programming (WLPP 2024); 7th Workshop on Models Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2024); and Second Workshop on Quantum Computing and Communication.

Part III : First Workshop on Advancements of Global Challenges Application; Second Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing; 5th Workshop on Applied High Performance Numerical Algorithms for PDEs; Special Session on Parallel EVD/SVD and its Application in Matrix Computations; 6th Minisymposium on HPC Applications in Physical Sciences; and 8th Workshop on Complex Collective Systems.

This book constitutes the refereed proceedings of the 15th International Conference on Parallel Processing and Applied Mathematics, PPAM 2024, held in Ostrava, Czech Republic, during September 8–11, 2024.

The 75 full papers included in this book were carefully reviewed and selected from 134 submissions. . The papers are organized in the following topical sections:

Part I : Numerical Algorithms and Parallel Scientific Computing; Architectural Aspects of HPC; Parallel Non-numerical Algorithms; GPU Computing; Performance Analysis and Prediction in HPCSystems; Environments and Frameworks for Parallel/Cloud/Edge Computing; and Applications of Parallel and Distributed Computing.

Part II : First PPAM Workshop on RISC-V (RISC-V PPAM 2024); Special Session on Scheduling for Parallel Computing; 10th Workshop on Language-Based Parallel Programming (WLPP 2024); 7th Workshop on Models Algorithms and Methodologies for Hybrid Parallelism in New HPC Systems (MAMHYP 2024); and Second Workshop on Quantum Computing and Communication.

Part III : First Workshop on Advancements of Global Challenges Application; Second Workshop on Applications of Machine Learning and Artificial Intelligence in High Performance Computing; 5th Workshop on Applied High Performance Numerical Algorithms for PDEs; Special Session on Parallel EVD/SVD and its Application in Matrix Computations; 6th Minisymposium on HPC Applications in PhysicalSciences; and 8th Workshop on Complex Collective Systems.