A Study of Some Fundamental Problems in Communication Complexity and Distributed Computing

A Study of Some Fundamental Problems in Communication Complexity and Distributed Computing
Author: Ranganath Kondapally
Publisher:
Total Pages: 188
Release: 2012
Genre:
ISBN:

"We study the complexity of some fundamental problems in two models of computation, namely, communication complexity and distributed computing. In communication complexity, we have two (or more) parties who want to compute a function on an input split between them. In distributed computing, we have some asynchronous processes which have a common goal such as electing a leader. Both models of computation have one thing in common: communication, in different forms, is a critical resource. We prove lower bounds on communication for some problems in each model. In communication complexity, we first study the AUGMENTED-INDEX problem, a variant of the well studied INDEX problem motivated by applications in data streams and data structures. Here, the two parties need to compute the value of a bit string (Alice's input) at a given location (Bob's input). In addition to the location, Bob is given a prefix of the bit string of Alice. This input sharing between the parties is notorious for making lower bounds harder to prove. We describe the complete tradeoff curve between Alice's information cost and Bob;s information cost that is tight everywhere. The tradeoffs hold under an "easy" distribution where the output is promised to be some fixed value always. We prove passes-space tradeoff for streaming verification of data structures such as priority queues, stacks, and double-ended queues, using the information cost tradeoffs. Second, we investigate the direct sum question, which is a deep and important question for any model of computation. Here, we want to know whether computing a function on k independent input instances requires k times the resources required to compute the function on a single input instance. We prove a direct sum theorem for the communication complexity of functions whose hardness is captured by smooth corruption bound (which subsumes corruption bound, smooth discrepancy, and discrepancy) under a product distribution. In fact, we show that smooth corruption bound lower bounds information cost, and information-theoretic measure of communication which naturally has a direct sum property, under product distibutions. Finally, we prove a time-space tradeoff of mutual exclusion, a fundamental problem in distributed computing, in the cache-coherent model. Two important implications of our bounds are that polynomial space is necessary to achieve constant remote memory references, and polynomial remote memory references will be incurred with constant space. Our bonds are optimal except when the space usage is small. The most interesting aspect of our bounds is that we prove that solving mutual exclusion--which involves "messy" systems details such as asynchrony and cache coherence--is equivalent to solving a simple and a purely combinatorial bin-pebble game that we design."

Communication Complexity and Parallel Computing

Communication Complexity and Parallel Computing
Author: Juraj Hromkovič
Publisher: Springer Science & Business Media
Total Pages: 347
Release: 2013-03-09
Genre: Computers
ISBN: 3662034425

The communication complexity of two-party protocols is an only 15 years old complexity measure, but it is already considered to be one of the fundamen tal complexity measures of recent complexity theory. Similarly to Kolmogorov complexity in the theory of sequential computations, communication complex ity is used as a method for the study of the complexity of concrete computing problems in parallel information processing. Especially, it is applied to prove lower bounds that say what computer resources (time, hardware, memory size) are necessary to compute the given task. Besides the estimation of the compu tational difficulty of computing problems the proved lower bounds are useful for proving the optimality of algorithms that are already designed. In some cases the knowledge about the communication complexity of a given problem may be even helpful in searching for efficient algorithms to this problem. The study of communication complexity becomes a well-defined indepen dent area of complexity theory. In addition to a strong relation to several funda mental complexity measures (and so to several fundamental problems of com plexity theory) communication complexity has contributed to the study and to the understanding of the nature of determinism, nondeterminism, and random ness in algorithmics. There already exists a non-trivial mathematical machinery to handle the communication complexity of concrete computing problems, which gives a hope that the approach based on communication complexity will be in strumental in the study of several central open problems of recent complexity theory.

Structural Information and Communication Complexity

Structural Information and Communication Complexity
Author: Thomas Moscibroda
Publisher: Springer
Total Pages: 367
Release: 2013-11-09
Genre: Computers
ISBN: 3319035789

This book constitutes the thoroughly refereed post-conference proceedings of the 20th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2013, held in Ischia, Italy, in July 2013. The 28 revised full papers presented were carefully reviewed and selected from 67 submissions. SIROCCO is devoted to the study of communication and knowledge in distributed systems. Special emphasis is given to innovative approaches and fundamental understanding, in addition to efforts to optimize current designs. The typical areas include distributed computing, communication networks, game theory, parallel computing, social networks, mobile computing (including autonomous robots), peer to peer systems, communication complexity, fault tolerant graph theories and randomized/probabilistic issues in networks.

Communication Complexity

Communication Complexity
Author: Anup Rao
Publisher: Cambridge University Press
Total Pages: 271
Release: 2020-02-20
Genre: Computers
ISBN: 1108776019

Communication complexity is the mathematical study of scenarios where several parties need to communicate to achieve a common goal, a situation that naturally appears during computation. This introduction presents the most recent developments in an accessible form, providing the language to unify several disjoint research subareas. Written as a guide for a graduate course on communication complexity, it will interest a broad audience in computer science, from advanced undergraduates to researchers in areas ranging from theory to algorithm design to distributed computing. The first part presents basic theory in a clear and illustrative way, offering beginners an entry into the field. The second part describes applications including circuit complexity, proof complexity, streaming algorithms, extension complexity of polytopes, and distributed computing. Proofs throughout the text use ideas from a wide range of mathematics, including geometry, algebra, and probability. Each chapter contains numerous examples, figures, and exercises to aid understanding.

Fault-tolerant Agreement in Synchronous Message-passing Systems

Fault-tolerant Agreement in Synchronous Message-passing Systems
Author: Michel Raynal
Publisher: Springer Nature
Total Pages: 167
Release: 2022-06-01
Genre: Computers
ISBN: 3031020014

Understanding distributed computing is not an easy task. This is due to the many facets of uncertainty one has to cope with and master in order to produce correct distributed software. A previous book Communication and Agreement Abstraction for Fault-tolerant Asynchronous Distributed Systems (published by Morgan & Claypool, 2010) was devoted to the problems created by crash failures in asynchronous message-passing systems. The present book focuses on the way to cope with the uncertainty created by process failures (crash, omission failures and Byzantine behavior) in synchronous message-passing systems (i.e., systems whose progress is governed by the passage of time). To that end, the book considers fundamental problems that distributed synchronous processes have to solve. These fundamental problems concern agreement among processes (if processes are unable to agree in one way or another in presence of failures, no non-trivial problem can be solved). They are consensus, interactive consistency, k-set agreement and non-blocking atomic commit. Being able to solve these basic problems efficiently with provable guarantees allows applications designers to give a precise meaning to the words ""cooperate"" and ""agree"" despite failures, and write distributed synchronous programs with properties that can be stated and proved. Hence, the aim of the book is to present a comprehensive view of agreement problems, algorithms that solve them and associated computability bounds in synchronous message-passing distributed systems. Table of Contents: List of Figures / Synchronous Model, Failure Models, and Agreement Problems / Consensus and Interactive Consistency in the Crash Failure Model / Expedite Decision in the Crash Failure Model / Simultaneous Consensus Despite Crash Failures / From Consensus to k-Set Agreement / Non-Blocking Atomic Commit in Presence of Crash Failures / k-Set Agreement Despite Omission Failures / Consensus Despite Byzantine Failures / Byzantine Consensus in Enriched Models

Structural Information and Communication Complexity

Structural Information and Communication Complexity
Author: Adrian Kosowski
Publisher: Springer Science & Business Media
Total Pages: 328
Release: 2011-06-24
Genre: Computers
ISBN: 3642222110

This book constitutes the refereed proceedings of the 18th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2011, held in Gdańsk, Poland, in June 2011. The 24 revised full papers presented together with 1 survey lecture and 2 invited talks were carefully reviewed and selected from 57 submissions. The papers are organized in topical section on fault tolerance, routing, mobile agents, mobile robots, probabilistic methods, distributed algorithms on graphs, and ad-hoc networks.

Structural Information and Communication Complexity

Structural Information and Communication Complexity
Author: Merav Parter
Publisher: Springer Nature
Total Pages: 311
Release: 2022-06-24
Genre: Computers
ISBN: 3031099931

This book constitutes the refereed conference proceedings of the 29th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2022, held in Paderborn, Germany, in June 2022. The 16 full papers presented in this book were carefully reviewed and selected from 30 submissions. SIROCCO is devoted to the study of the interplay between structural knowledge, communication, and computing in decentralized systems of multiple communicating entities. Special emphasis is given to innovative approaches leading to better understanding of the relationship between computing and communication.

Structural Information and Communication Complexity

Structural Information and Communication Complexity
Author: Pascal Felber
Publisher: Springer
Total Pages: 315
Release: 2008-06-17
Genre: Computers
ISBN: 3540693556

The Colloquium on Structure, Information, Communication, and Complexity (SIROCCO) is an annual research meeting focused on the relationship between information and e?ciency in decentralized (distributed, parallel, and network) computing.Thisyear,SIROCCOcelebratedits15thanniversary.Overtheyears, the colloquium has become a widely recognized forum bringing together - searchers interested in the fundamental principles underlying the interplay - tween local structural knowledge and global communication and computation complexity. SIROCCO covers topics such as distributed algorithms, compact data structures, information dissemination, informative labeling schemes, c- binatorial optimization, and others, with potential applications to large-scale distributed systems including global computing platforms, peer-to-peer systems andapplications,socialnetworks,wirelessnetworks,andnetworkprotocols(such as routing, broadcasting, localization). SIROCCO 2008 was held in Villars-sur- Ollon, in the Swiss Alps, June 17–20, 2008. There were 52 contributions submitted to SIROCCO 2008. All papers - derwent a thorough refereeing process, where each submission was reviewed by at least 3, and on average 3.4, Program Committee members. After in-depth discussions, the Program Committee selected 22 high-quality contributions for presentation at the colloquium and publication in this volume. We thank the authors of all the submitted papers, the Program Committee members, and the external reviewers. Without their dedication, we could not have prepared a program of such quality. ThereweretwoinvitedspeakersatSIROCCO2008:NicolaSantoro(Carleton University) and Boaz Patt-Shamir (Tel-Aviv University). We express our gratitude to the SIROCCO Steering Committee, and in p- ticulartoPierreFraigniaudforhisenthusiasmandhisinvaluablehelpthroughout the preparation of this event.

Structural Information and Communication Complexity

Structural Information and Communication Complexity
Author: Guy Even
Publisher: Springer
Total Pages: 355
Release: 2012-06-25
Genre: Computers
ISBN: 3642311040

This book constitutes the refereed proceedings of the 19th International Colloquium on Structural Information and Communication Complexity, SIROCCO 2012, held in Reykjavik, Iceland for 3 days starting June 30, 2012. The 28 revised full papers presented were carefully reviewed and selected from 54 submissions. SIROCCO is devoted to the study of communication and knowledge in distributed systems. Special emphasis is given to innovative approaches and fundamental understanding, in addition to efforts to optimize current designs. The typical areas include distributed computing, communication networks, game theory, parallel computing, social networks, mobile computing (including autonomous robots), peer to peer systems, communication complexity, fault tolerant graph theories, and randomized/probabilistic issues in networks.