Main Memory Database Systems

Main Memory Database Systems
Author: Frans Faerber
Publisher: Foundations and Trends in Databases
Total Pages: 144
Release: 2017-07-20
Genre: Probabilistic databases
ISBN: 9781680833249

With growing memory sizes and memory prices dropping by a factor of 10 every 5 years, data having a "primary home" in memory is now a reality. Main-memory databases eschew many of the traditional architectural pillars of relational database systems that optimized for disk-resident data. The result of these memory-optimized designs are systems that feature several innovative approaches to fundamental issues (e.g., concurrency control, query processing) that achieve orders of magnitude performance improvements over traditional designs. This monograph provides an overview of recent developments in main-memory database systems. It covers five main issues and architectural choices that need to be made when building a high performance main-memory optimized database: data organization and storage, indexing, concurrency control, durability and recovery techniques, and query processing and compilation. The monograph focuses on four commercial and research systems: H-Store/VoltDB, Hekaton, HyPer, and SAPHANA. These systems are diverse in their design choices and form a representative sample of the state of the art in main-memory database systems. It also covers other commercial and academic systems, along with current and future research trends.

Non-Volatile Memory Database Management Systems

Non-Volatile Memory Database Management Systems
Author: Joy Arulraj
Publisher: Springer Nature
Total Pages: 173
Release: 2022-06-01
Genre: Computers
ISBN: 3031018680

This book explores the implications of non-volatile memory (NVM) for database management systems (DBMSs). The advent of NVM will fundamentally change the dichotomy between volatile memory and durable storage in DBMSs. These new NVM devices are almost as fast as volatile memory, but all writes to them are persistent even after power loss. Existing DBMSs are unable to take full advantage of this technology because their internal architectures are predicated on the assumption that memory is volatile. With NVM, many of the components of legacy DBMSs are unnecessary and will degrade the performance of data-intensive applications. We present the design and implementation of DBMS architectures that are explicitly tailored for NVM. The book focuses on three aspects of a DBMS: (1) logging and recovery, (2) storage and buffer management, and (3) indexing. First, we present a logging and recovery protocol that enables the DBMS to support near-instantaneous recovery. Second, we propose a storage engine architecture and buffer management policy that leverages the durability and byte-addressability properties of NVM to reduce data duplication and data migration. Third, the book presents the design of a range index tailored for NVM that is latch-free yet simple to implement. All together, the work described in this book illustrates that rethinking the fundamental algorithms and data structures employed in a DBMS for NVM improves performance and availability, reduces operational cost, and simplifies software development.

Building a Columnar Database on RAMCloud

Building a Columnar Database on RAMCloud
Author: Christian Tinnefeld
Publisher: Springer
Total Pages: 139
Release: 2015-07-07
Genre: Computers
ISBN: 3319207113

This book examines the field of parallel database management systems and illustrates the great variety of solutions based on a shared-storage or a shared-nothing architecture. Constantly dropping memory prices and the desire to operate with low-latency responses on large sets of data paved the way for main memory-based parallel database management systems. However, this area is currently dominated by the shared-nothing approach in order to preserve the in-memory performance advantage by processing data locally on each server. The main argument this book makes is that such an unilateral development will cease due to the combination of the following three trends: a) Today’s network technology features remote direct memory access (RDMA) and narrows the performance gap between accessing main memory on a server and of a remote server to and even below a single order of magnitude. b) Modern storage systems scale gracefully, are elastic and provide high-availability. c) A modern storage system such as Stanford’s RAM Cloud even keeps all data resident in the main memory. Exploiting these characteristics in the context of a main memory-based parallel database management system is desirable. The book demonstrates that the advent of RDMA-enabled network technology makes the creation of a parallel main memory DBMS based on a shared-storage approach feasible.

Multimedia Database Management Systems

Multimedia Database Management Systems
Author: B. Thuraisingham
Publisher: Springer Science & Business Media
Total Pages: 152
Release: 2012-12-06
Genre: Computers
ISBN: 1461561493

Multimedia Database Management Systems brings together in one place important contributions and up-to-date research results in this important area. Multimedia Database Management Systems serves as an excellent reference, providing insight into some of the most important research issues in the field.

In-Memory Data Management

In-Memory Data Management
Author: Hasso Plattner
Publisher: Springer Science & Business Media
Total Pages: 245
Release: 2011-03-08
Genre: Business & Economics
ISBN: 3642193633

In the last 50 years the world has been completely transformed through the use of IT. We have now reached a new inflection point. Here we present, for the first time, how in-memory computing is changing the way businesses are run. Today, enterprise data is split into separate databases for performance reasons. Analytical data resides in warehouses, synchronized periodically with transactional systems. This separation makes flexible, real-time reporting on current data impossible. Multi-core CPUs, large main memories, cloud computing and powerful mobile devices are serving as the foundation for the transition of enterprises away from this restrictive model. We describe techniques that allow analytical and transactional processing at the speed of thought and enable new ways of doing business. The book is intended for university students, IT-professionals and IT-managers, but also for senior management who wish to create new business processes by leveraging in-memory computing.

Readings in Database Systems

Readings in Database Systems
Author: Joseph M. Hellerstein
Publisher: MIT Press
Total Pages: 884
Release: 2005
Genre: Computers
ISBN: 9780262693141

The latest edition of a popular text and reference on database research, with substantial new material and revision; covers classical literature and recent hot topics. Lessons from database research have been applied in academic fields ranging from bioinformatics to next-generation Internet architecture and in industrial uses including Web-based e-commerce and search engines. The core ideas in the field have become increasingly influential. This text provides both students and professionals with a grounding in database research and a technical context for understanding recent innovations in the field. The readings included treat the most important issues in the database area--the basic material for any DBMS professional. This fourth edition has been substantially updated and revised, with 21 of the 48 papers new to the edition, four of them published for the first time. Many of the sections have been newly organized, and each section includes a new or substantially revised introduction that discusses the context, motivation, and controversies in a particular area, placing it in the broader perspective of database research. Two introductory articles, never before published, provide an organized, current introduction to basic knowledge of the field; one discusses the history of data models and query languages and the other offers an architectural overview of a database system. The remaining articles range from the classical literature on database research to treatments of current hot topics, including a paper on search engine architecture and a paper on application servers, both written expressly for this edition. The result is a collection of papers that are seminal and also accessible to a reader who has a basic familiarity with database systems.

In-Memory Data Management

In-Memory Data Management
Author: Hasso Plattner
Publisher: Springer Science & Business Media
Total Pages: 286
Release: 2012-04-17
Genre: Business & Economics
ISBN: 3642295754

In the last fifty years the world has been completely transformed through the use of IT. We have now reached a new inflection point. This book presents, for the first time, how in-memory data management is changing the way businesses are run. Today, enterprise data is split into separate databases for performance reasons. Multi-core CPUs, large main memories, cloud computing and powerful mobile devices are serving as the foundation for the transition of enterprises away from this restrictive model. This book provides the technical foundation for processing combined transactional and analytical operations in the same database. In the year since we published the first edition of this book, the performance gains enabled by the use of in-memory technology in enterprise applications has truly marked an inflection point in the market. The new content in this second edition focuses on the development of these in-memory enterprise applications, showing how they leverage the capabilities of in-memory technology. The book is intended for university students, IT-professionals and IT-managers, but also for senior management who wish to create new business processes.

Real-Time Database Systems

Real-Time Database Systems
Author: Azer Bestavros
Publisher: Springer Science & Business Media
Total Pages: 376
Release: 2012-12-06
Genre: Computers
ISBN: 1461561612

Despite the growing interest in Real-Time Database Systems, there is no single book that acts as a reference to academics, professionals, and practitioners who wish to understand the issues involved in the design and development of RTDBS. Real-Time Database Systems: Issues and Applications fulfills this need. This book presents the spectrum of issues that may arise in various real-time database applications, the available solutions and technologies that may be used to address these issues, and the open problems that need to be tackled in the future. With rapid advances in this area, several concepts have been proposed without a widely accepted consensus on their definitions and implications. To address this need, the first chapter is an introduction to the key RTDBS concepts and definitions, which is followed by a survey of the state of the art in RTDBS research and practice. The remainder of the book consists of four sections: models and paradigms, applications and benchmarks, scheduling and concurrency control, and experimental systems. The chapters in each section are contributed by experts in the respective areas. Real-Time Database Systems: Issues and Applications is primarily intended for practicing engineers and researchers working in the growing area of real-time database systems. For practitioners, the book will provide a much needed bridge for technology transfer and continued education. For researchers, this book will provide a comprehensive reference for well-established results. This book can also be used in a senior or graduate level course on real-time systems, real-time database systems, and database systems or closely related courses.

Database and Expert Systems Applications

Database and Expert Systems Applications
Author: Trevor Bench-Capon
Publisher: Springer Science & Business Media
Total Pages: 1123
Release: 1999-08-20
Genre: Computers
ISBN: 3540664483

The Database and Expert Systems Applications (DEXA) conferences bring together researchers and practitioners from all over the world to exchange ideas, experiences and opinions in a friendly and stimulating environment. The papers are at once a record of what has been achieved and the first steps towards shaping the future of information systems. DEXA covers a broad field, and all aspects of database, knowledge base and related technologies and their applications are represented. Once again there were a good number of submissions: 241 papers were submitted and of these the programme committee selected 103 to be presented. DEXA’99 took place in Florence and was the tenth conference in the series, following events in Vienna, Berlin, Valencia, Prague, Athens, London, Zurich, Toulouse and Vienna. The decade has seen many developments in the areas covered by DEXA, developments in which DEXA has played its part. I would like to express thanks to all the institutions which have actively supported and made possible this conference, namely: • University of Florence, Italy • IDG CNR, Italy • FAW – University of Linz, Austria • Austrian Computer Society • DEXA Association In addition, we must thank all the people who have contributed their time and effort to make the conference possible. Special thanks go to Maria Schweikert (Technical University of Vienna), M. Neubauer and G. Wagner (FAW, University of Linz). We must also thank all the members of the programme committee, whose careful reviews are important to the quality of the conference.

Database Internals

Database Internals
Author: Alex Petrov
Publisher: O'Reilly Media
Total Pages: 373
Release: 2019-09-13
Genre: Computers
ISBN: 1492040312

When it comes to choosing, using, and maintaining a database, understanding its internals is essential. But with so many distributed databases and tools available today, it’s often difficult to understand what each one offers and how they differ. With this practical guide, Alex Petrov guides developers through the concepts behind modern database and storage engine internals. Throughout the book, you’ll explore relevant material gleaned from numerous books, papers, blog posts, and the source code of several open source databases. These resources are listed at the end of parts one and two. You’ll discover that the most significant distinctions among many modern databases reside in subsystems that determine how storage is organized and how data is distributed. This book examines: Storage engines: Explore storage classification and taxonomy, and dive into B-Tree-based and immutable Log Structured storage engines, with differences and use-cases for each Storage building blocks: Learn how database files are organized to build efficient storage, using auxiliary data structures such as Page Cache, Buffer Pool and Write-Ahead Log Distributed systems: Learn step-by-step how nodes and processes connect and build complex communication patterns Database clusters: Which consistency models are commonly used by modern databases and how distributed storage systems achieve consistency