High-Performance Big Data Computing

High-Performance Big Data Computing
Author: Dhabaleswar K. Panda
Publisher: MIT Press
Total Pages: 275
Release: 2022-08-02
Genre: Computers
ISBN: 0262369427

An in-depth overview of an emerging field that brings together high-performance computing, big data processing, and deep lLearning. Over the last decade, the exponential explosion of data known as big data has changed the way we understand and harness the power of data. The emerging field of high-performance big data computing, which brings together high-performance computing (HPC), big data processing, and deep learning, aims to meet the challenges posed by large-scale data processing. This book offers an in-depth overview of high-performance big data computing and the associated technical issues, approaches, and solutions. The book covers basic concepts and necessary background knowledge, including data processing frameworks, storage systems, and hardware capabilities; offers a detailed discussion of technical issues in accelerating big data computing in terms of computation, communication, memory and storage, codesign, workload characterization and benchmarking, and system deployment and management; and surveys benchmarks and workloads for evaluating big data middleware systems. It presents a detailed discussion of big data computing systems and applications with high-performance networking, computing, and storage technologies, including state-of-the-art designs for data processing and storage systems. Finally, the book considers some advanced research topics in high-performance big data computing, including designing high-performance deep learning over big data (DLoBD) stacks and HPC cloud technologies.

High-Performance Big-Data Analytics

High-Performance Big-Data Analytics
Author: Pethuru Raj
Publisher: Springer
Total Pages: 443
Release: 2015-10-16
Genre: Computers
ISBN: 331920744X

This book presents a detailed review of high-performance computing infrastructures for next-generation big data and fast data analytics. Features: includes case studies and learning activities throughout the book and self-study exercises in every chapter; presents detailed case studies on social media analytics for intelligent businesses and on big data analytics (BDA) in the healthcare sector; describes the network infrastructure requirements for effective transfer of big data, and the storage infrastructure requirements of applications which generate big data; examines real-time analytics solutions; introduces in-database processing and in-memory analytics techniques for data mining; discusses the use of mainframes for handling real-time big data and the latest types of data management systems for BDA; provides information on the use of cluster, grid and cloud computing systems for BDA; reviews the peer-to-peer techniques and tools and the common information visualization techniques, used in BDA.

High-Performance Modelling and Simulation for Big Data Applications

High-Performance Modelling and Simulation for Big Data Applications
Author: Joanna Kołodziej
Publisher: Springer
Total Pages: 364
Release: 2019-03-25
Genre: Computers
ISBN: 3030162729

This open access book was prepared as a Final Publication of the COST Action IC1406 “High-Performance Modelling and Simulation for Big Data Applications (cHiPSet)“ project. Long considered important pillars of the scientific method, Modelling and Simulation have evolved from traditional discrete numerical methods to complex data-intensive continuous analytical optimisations. Resolution, scale, and accuracy have become essential to predict and analyse natural and complex systems in science and engineering. When their level of abstraction raises to have a better discernment of the domain at hand, their representation gets increasingly demanding for computational and data resources. On the other hand, High Performance Computing typically entails the effective use of parallel and distributed processing units coupled with efficient storage, communication and visualisation systems to underpin complex data-intensive applications in distinct scientific and technical domains. It is then arguably required to have a seamless interaction of High Performance Computing with Modelling and Simulation in order to store, compute, analyse, and visualise large data sets in science and engineering. Funded by the European Commission, cHiPSet has provided a dynamic trans-European forum for their members and distinguished guests to openly discuss novel perspectives and topics of interests for these two communities. This cHiPSet compendium presents a set of selected case studies related to healthcare, biological data, computational advertising, multimedia, finance, bioinformatics, and telecommunications.

High Performance Computing for Big Data

High Performance Computing for Big Data
Author: Chao Wang
Publisher: CRC Press
Total Pages: 360
Release: 2017-10-16
Genre: Computers
ISBN: 1351651579

High-Performance Computing for Big Data: Methodologies and Applications explores emerging high-performance architectures for data-intensive applications, novel efficient analytical strategies to boost data processing, and cutting-edge applications in diverse fields, such as machine learning, life science, neural networks, and neuromorphic engineering. The book is organized into two main sections. The first section covers Big Data architectures, including cloud computing systems, and heterogeneous accelerators. It also covers emerging 3D IC design principles for memory architectures and devices. The second section of the book illustrates emerging and practical applications of Big Data across several domains, including bioinformatics, deep learning, and neuromorphic engineering. Features Covers a wide range of Big Data architectures, including distributed systems like Hadoop/Spark Includes accelerator-based approaches for big data applications such as GPU-based acceleration techniques, and hardware acceleration such as FPGA/CGRA/ASICs Presents emerging memory architectures and devices such as NVM, STT- RAM, 3D IC design principles Describes advanced algorithms for different big data application domains Illustrates novel analytics techniques for Big Data applications, scheduling, mapping, and partitioning methodologies Featuring contributions from leading experts, this book presents state-of-the-art research on the methodologies and applications of high-performance computing for big data applications. About the Editor Dr. Chao Wang is an Associate Professor in the School of Computer Science at the University of Science and Technology of China. He is the Associate Editor of ACM Transactions on Design Automations for Electronics Systems (TODAES), Applied Soft Computing, Microprocessors and Microsystems, IET Computers & Digital Techniques, and International Journal of Electronics. Dr. Chao Wang was the recipient of Youth Innovation Promotion Association, CAS, ACM China Rising Star Honorable Mention (2016), and best IP nomination of DATE 2015. He is now on the CCF Technical Committee on Computer Architecture, CCF Task Force on Formal Methods. He is a Senior Member of IEEE, Senior Member of CCF, and a Senior Member of ACM.

Conquering Big Data with High Performance Computing

Conquering Big Data with High Performance Computing
Author: Ritu Arora
Publisher: Springer
Total Pages: 328
Release: 2016-09-16
Genre: Computers
ISBN: 3319337424

This book provides an overview of the resources and research projects that are bringing Big Data and High Performance Computing (HPC) on converging tracks. It demystifies Big Data and HPC for the reader by covering the primary resources, middleware, applications, and tools that enable the usage of HPC platforms for Big Data management and processing.Through interesting use-cases from traditional and non-traditional HPC domains, the book highlights the most critical challenges related to Big Data processing and management, and shows ways to mitigate them using HPC resources. Unlike most books on Big Data, it covers a variety of alternatives to Hadoop, and explains the differences between HPC platforms and Hadoop.Written by professionals and researchers in a range of departments and fields, this book is designed for anyone studying Big Data and its future directions. Those studying HPC will also find the content valuable.

Supercomputing Frontiers

Supercomputing Frontiers
Author: Rio Yokota
Publisher: Springer
Total Pages: 301
Release: 2018-03-20
Genre: Computers
ISBN: 3319699539

It constitutes the refereed proceedings of the 4th Asian Supercomputing Conference, SCFA 2018, held in Singapore in March 2018. Supercomputing Frontiers will be rebranded as Supercomputing Frontiers Asia (SCFA), which serves as the technical programme for SCA18. The technical programme for SCA18 consists of four tracks: Application, Algorithms & Libraries Programming System Software Architecture, Network/Communications & Management Data, Storage & Visualisation The 20 papers presented in this volume were carefully reviewed nd selected from 60 submissions.

Advances in High Performance Computing

Advances in High Performance Computing
Author: Ivan Dimov
Publisher: Springer Nature
Total Pages: 472
Release: 2020-08-07
Genre: Technology & Engineering
ISBN: 3030553477

Every day we need to solve large problems for which supercomputers are needed. High performance computing (HPC) is a paradigm that allows to efficiently implement large-scale computational tasks on powerful supercomputers unthinkable without optimization. We try to minimize our effort and to maximize the achieved profit. Many challenging real world problems arising in engineering, economics, medicine and other areas can be formulated as large-scale computational tasks. The volume is a comprehensive collection of extended contributions from the High performance computing conference held in Borovets, Bulgaria, September 2019. This book presents recent advances in high performance computing. The topics of interest included into this volume are: HP software tools, Parallel Algorithms and Scalability, HPC in Big Data analytics, Modelling, Simulation & Optimization in a Data Rich Environment, Advanced numerical methods for HPC, Hybrid parallel or distributed algorithms. The volume is focused on important large-scale applications like Environmental and Climate Modeling, Computational Chemistry and Heuristic Algorithms.

High-Performance Computing and Big Data Analysis

High-Performance Computing and Big Data Analysis
Author: Lucio Grandinetti
Publisher: Springer Nature
Total Pages: 520
Release: 2019-10-19
Genre: Computers
ISBN: 3030334953

This book constitutes revised and selected papers from the Second International Congress on High-Performance Computing and Big Data Analysis, TopHPC 2019, held in Tehran, Iran, in April 2019. The 37 full papers and 2 short papers presented in this volume were carefully reviewed and selected from a total of 103 submissions. The papers in the volume are organized acording to the following topical headings: deep learning; big data analytics; Internet of Things.- data mining, neural network and genetic algorithms; performance issuesand quantum computing.

High Performance Computing

High Performance Computing
Author: Sergio Nesmachnow
Publisher: Springer Nature
Total Pages: 229
Release: 2021-02-02
Genre: Computers
ISBN: 3030680355

This book constitutes revised selected papers of the 7th Latin American High Performance Computing Conference, CARLA 2020, held in Cuenca, Ecuador, in September 2020. Due to the COVID-19 pandemic the conference was held in a virtual mode. The 15 revised full papers presented were carefully reviewed and selected out of 36 submissions. The papers included in this book are organized according to the topics on ​High Performance Computing Applications; High Performance Computing and Artificial Intelligence.

Open Source Software for Statistical Analysis of Big Data: Emerging Research and Opportunities

Open Source Software for Statistical Analysis of Big Data: Emerging Research and Opportunities
Author: Segall, Richard S.
Publisher: IGI Global
Total Pages: 237
Release: 2020-02-21
Genre: Computers
ISBN: 1799827704

With the development of computing technologies in today’s modernized world, software packages have become easily accessible. Open source software, specifically, is a popular method for solving certain issues in the field of computer science. One key challenge is analyzing big data due to the high amounts that organizations are processing. Researchers and professionals need research on the foundations of open source software programs and how they can successfully analyze statistical data. Open Source Software for Statistical Analysis of Big Data: Emerging Research and Opportunities provides emerging research exploring the theoretical and practical aspects of cost-free software possibilities for applications within data analysis and statistics with a specific focus on R and Python. Featuring coverage on a broad range of topics such as cluster analysis, time series forecasting, and machine learning, this book is ideally designed for researchers, developers, practitioners, engineers, academicians, scholars, and students who want to more fully understand in a brief and concise format the realm and technologies of open source software for big data and how it has been used to solve large-scale research problems in a multitude of disciplines.