A Systolic Array Parallelizing Compiler

A Systolic Array Parallelizing Compiler
Author: Ping-Sheng Tseng
Publisher: Springer Science & Business Media
Total Pages: 140
Release: 2012-12-06
Genre: Computers
ISBN: 146131559X

Widespread use of parallel processing will become a reality only if the process of porting applications to parallel computers can be largely automated. Usually it is straightforward for a user to determine how an application can be mapped onto a parallel machine; however, the actual development of parallel code, if done by hand, is typically difficult and time consuming. Parallelizing compilers, which can gen erate parallel code automatically, are therefore a key technology for parallel processing. In this book, Ping-Sheng Tseng describes a parallelizing compiler for systolic arrays, called AL. Although parallelizing compilers are quite common for shared-memory parallel machines, the AL compiler is one of the first working parallelizing compilers for distributed memory machines, of which systolic arrays are a special case. The AL compiler takes advantage of the fine grain and high bandwidth interprocessor communication capabilities in a systolic architecture to generate efficient parallel code. xii Foreword While capable of handling an important class of applications, AL is not intended to be a general-purpose parallelizing compiler.

Parallel Computing and Transputers

Parallel Computing and Transputers
Author: D. Arnold
Publisher: IOS Press
Total Pages: 398
Release: 1994
Genre: Computers
ISBN: 9789051991499

The broadening of interest in parellel computing and transputers is reflected in this text. Topics covered include: concurrent programming; graphics and image processing; and robotics and control. It is based on the proceedings of the 6th Australian Transputer and Occam User Group.

A Systolic Array Optimizing Compiler

A Systolic Array Optimizing Compiler
Author: Monica S. Lam
Publisher: Springer Science & Business Media
Total Pages: 217
Release: 2012-12-06
Genre: Technology & Engineering
ISBN: 1461317053

This book is a revision of my Ph. D. thesis dissertation submitted to Carnegie Mellon University in 1987. It documents the research and results of the compiler technology developed for the Warp machine. Warp is a systolic array built out of custom, high-performance processors, each of which can execute up to 10 million floating-point operations per second (10 MFLOPS). Under the direction of H. T. Kung, the Warp machine matured from an academic, experimental prototype to a commercial product of General Electric. The Warp machine demonstrated that the scalable architecture of high-peiformance, programmable systolic arrays represents a practical, cost-effective solu tion to the present and future computation-intensive applications. The success of Warp led to the follow-on iWarp project, a joint project with Intel, to develop a single-chip 20 MFLOPS processor. The availability of the highly integrated iWarp processor will have a significant impact on parallel computing. One of the major challenges in the development of Warp was to build an optimizing compiler for the machine. First, the processors in the xx A Systolic Array Optimizing Compiler array cooperate at a fine granularity of parallelism, interaction between processors must be considered in the generation of code for individual processors. Second, the individual processors themselves derive their performance from a VLIW (Very Long Instruction Word) instruction set and a high degree of internal pipelining and parallelism. The compiler contains optimizations pertaining to the array level of parallelism, as well as optimizations for the individual VLIW processors.

IWarp

IWarp
Author: Thomas Gross
Publisher: MIT Press
Total Pages: 524
Release: 1998
Genre: Computers
ISBN: 9780262071833

This book describes the complete iWarp system, from instruction-level parallelism to final parallel applications. The authors present a range of issues that must be considered to get a real system into practice. foreword by Gordon Bell and afterword by H.T. Kung Although researchers have proposed many mechanisms and theories for parallel systems, only a few have actually resulted in working computing platforms. The iWarp is an experimental parallel system that was designed and built jointly by Carnegie Mellon University and Intel Corporation. The system is based on the idea of integrating a VLIW processor and a sophisticated fine-grained communication system on a single chip. This book describes the complete iWarp system, from instruction-level parallelism to final parallel applications. The authors present a range of issues that must be considered to get a real system into practice. They also provide a start-to-finish history of the project, including what was done right and what was done wrong, that will be of interest to anyone who studies or builds computer systems.

Automatic Parallelization for a Class of Regular Computations

Automatic Parallelization for a Class of Regular Computations
Author: G. M. Megson
Publisher: World Scientific
Total Pages: 280
Release: 1997
Genre: Computers
ISBN: 9789810228064

The automatic generation of parallel code from high level sequential description is of key importance to the wide spread use of high performance machine architectures. This text considers (in detail) the theory and practical realization of automatic mapping of algorithms generated from systems of uniform recurrence equations (do-lccps) onto fixed size architectures with defined communication primitives. Experimental results of the mapping scheme and its implementation are given.

Opportunities and Constraints of Parallel Computing

Opportunities and Constraints of Parallel Computing
Author: Jorge L.C. Sanz
Publisher: Springer Science & Business Media
Total Pages: 153
Release: 2012-12-06
Genre: Computers
ISBN: 1461396689

At the initiative of the IBM Almaden Research Center and the National Science Foundation, a workshop on "Opportunities and Constraints of Parallel Computing" was held in San Jose, California, on December 5-6, 1988. The Steering Committee of the workshop consisted of Prof. R. Karp (University of California at Berkeley), Prof. L. Snyder (University of Washington at Seattle), and Dr. J. L. C. Sanz (IBM Almaden Research Center). This workshop was intended to provide a vehicle for interaction for people in the technical community actively engaged in research on parallel computing. One major focus of the workshop was massive parallelism, covering theory and models of computing, algorithm design and analysis, routing architectures and interconnection networks, languages, and application requirements. More conventional issues involving the design and use of parallel computers with a few dozen processors were not addressed at the meeting. A driving force behind the realization of this workshop was the need for interaction between theoreticians and practitioners of parallel computation. Therefore, a group of selected participants from the theory community was invited to attend, together with well-known colleagues actively involved in parallelism from national laboratories, government agencies, and industry.

Software for Parallel Computation

Software for Parallel Computation
Author: Janusz S. Kowalik
Publisher: Springer Science & Business Media
Total Pages: 380
Release: 1993-04-13
Genre: Computers
ISBN: 9783540564515

Proceedings of the NATO Advanced Workshop on Software for Parallel Computation, held at Cetraro, Cosenza, Italy, June 22-26, 1992

Algorithms for Parallel Processing

Algorithms for Parallel Processing
Author: Michael T. Heath
Publisher: Springer Science & Business Media
Total Pages: 373
Release: 2012-12-06
Genre: Mathematics
ISBN: 1461215161

This IMA Volume in Mathematics and its Applications ALGORITHMS FOR PARALLEL PROCESSING is based on the proceedings of a workshop that was an integral part of the 1996-97 IMA program on "MATHEMATICS IN HIGH-PERFORMANCE COMPUTING. " The workshop brought together algorithm developers from theory, combinatorics, and scientific computing. The topics ranged over models, linear algebra, sorting, randomization, and graph algorithms and their analysis. We thank Michael T. Heath of University of lllinois at Urbana (Com puter Science), Abhiram Ranade of the Indian Institute of Technology (Computer Science and Engineering), and Robert S. Schreiber of Hewlett Packard Laboratories for their excellent work in organizing the workshop and editing the proceedings. We also take this opportunity to thank the National Science Founda tion (NSF) and the Army Research Office (ARO), whose financial support made the workshop possible. A vner Friedman Robert Gulliver v PREFACE The Workshop on Algorithms for Parallel Processing was held at the IMA September 16 - 20, 1996; it was the first workshop of the IMA year dedicated to the mathematics of high performance computing. The work shop organizers were Abhiram Ranade of The Indian Institute of Tech nology, Bombay, Michael Heath of the University of Illinois, and Robert Schreiber of Hewlett Packard Laboratories. Our idea was to bring together researchers who do innovative, exciting, parallel algorithms research on a wide range of topics, and by sharing insights, problems, tools, and methods to learn something of value from one another.

Parallel Processing

Parallel Processing
Author: Bruno Buchberger
Publisher: Springer Science & Business Media
Total Pages: 918
Release: 1994-08-30
Genre: Computers
ISBN: 9783540584308

Proceedings -- Parallel Computing.