Data Management on Non-volatile Memory: from Mobile Applications to Large-scale Databases

Data Management on Non-volatile Memory: from Mobile Applications to Large-scale Databases
Author:
Publisher:
Total Pages: 119
Release: 2019
Genre: Electronic books
ISBN:

The non-volatile memory technique advanced rapidly in recent years. First, mature NAND flash memory is getting cheaper and denser. It has impacted our daily life. Second, emerging persistent memory technologies such as 3d XPoint have demonstrated great potentials in revolutionizing modern memory hierarchy. In this research, we first carry out a project on the mature NAND-flash-based solid state drives. We propose a new RAID5 technique called CR5M to enhance data reliability within a single SSD for safety-critical mobile applications. We also proposed an associated data reconstruction strategy called MCR to further shrink the window of vulnerability. Compared with traditional RAID5, CR5M can achieve up to 40.2% performance improvement. The data recovery speed is also improved by 7.5%. Because persistent memory is byte-addressable and has near-DRAM access speed, it exhibits a huge potential to build a hybrid memory system where both DRAM and PM are directly connected to a CPU. We designed a concurrent hash-assisted radix tree for DRAM-PM Hybrid Memory Systems. In such a system, an efficient indexing data structure such as a persistent tree becomes an indispensable component. Designing a capable persistent tree, however, is challenging as it has to ensure consistency, persistence, and scalability without substantially degrading performance. We propose a novel concurrent and persistent tree called HART (Hash-assisted ART), which employs a hash table to manage ARTs. HART not only optimize its performance but also prevent persistent memory leaks. In most cases, HART significantly outperforms WOART and FPTree, two state-of-the-art persistent trees. Also, it scales well in concurrent scenarios. Then, we proposed multi-hashing, a dual-level hash table indexing for a highperformance, large-capacity, and low-cost in-memory database. Multi-hashing is also built on a DRAM-PM hybrid memory system. On the DRAM level, an indexing structure is designed to be memory-efficient to manage hot indexes. On the PM level, another indexing data structure is designed to be performance-optimized. The indexes in DRAM will be merged into PM periodically. Our experimental results show that multi-hashing shows better performance under Sparse workloads when compared with HART. It also consumes less memory under both Dense and Sparse workloads.

Non-Volatile Memory Database Management Systems

Non-Volatile Memory Database Management Systems
Author: Joy Arulraj
Publisher: Springer Nature
Total Pages: 173
Release: 2022-06-01
Genre: Computers
ISBN: 3031018680

This book explores the implications of non-volatile memory (NVM) for database management systems (DBMSs). The advent of NVM will fundamentally change the dichotomy between volatile memory and durable storage in DBMSs. These new NVM devices are almost as fast as volatile memory, but all writes to them are persistent even after power loss. Existing DBMSs are unable to take full advantage of this technology because their internal architectures are predicated on the assumption that memory is volatile. With NVM, many of the components of legacy DBMSs are unnecessary and will degrade the performance of data-intensive applications. We present the design and implementation of DBMS architectures that are explicitly tailored for NVM. The book focuses on three aspects of a DBMS: (1) logging and recovery, (2) storage and buffer management, and (3) indexing. First, we present a logging and recovery protocol that enables the DBMS to support near-instantaneous recovery. Second, we propose a storage engine architecture and buffer management policy that leverages the durability and byte-addressability properties of NVM to reduce data duplication and data migration. Third, the book presents the design of a range index tailored for NVM that is latch-free yet simple to implement. All together, the work described in this book illustrates that rethinking the fundamental algorithms and data structures employed in a DBMS for NVM improves performance and availability, reduces operational cost, and simplifies software development.

In-Memory Data Management

In-Memory Data Management
Author: Hasso Plattner
Publisher: Springer Science & Business Media
Total Pages: 286
Release: 2012-04-17
Genre: Business & Economics
ISBN: 3642295754

In the last fifty years the world has been completely transformed through the use of IT. We have now reached a new inflection point. This book presents, for the first time, how in-memory data management is changing the way businesses are run. Today, enterprise data is split into separate databases for performance reasons. Multi-core CPUs, large main memories, cloud computing and powerful mobile devices are serving as the foundation for the transition of enterprises away from this restrictive model. This book provides the technical foundation for processing combined transactional and analytical operations in the same database. In the year since we published the first edition of this book, the performance gains enabled by the use of in-memory technology in enterprise applications has truly marked an inflection point in the market. The new content in this second edition focuses on the development of these in-memory enterprise applications, showing how they leverage the capabilities of in-memory technology. The book is intended for university students, IT-professionals and IT-managers, but also for senior management who wish to create new business processes.

Data Management for Mobile Computing

Data Management for Mobile Computing
Author: Evaggelia Pitoura
Publisher: Springer Science & Business Media
Total Pages: 164
Release: 2012-12-06
Genre: Computers
ISBN: 1461555272

Earth date, August 11, 1997 "Beam me up Scottie!" "We cannot do it! This is not Star Trek's Enterprise. This is early years Earth." True, this is not yet the era of Star Trek, we cannot beam captain James T. Kirk or captain Jean Luc Pickard or an apple or anything else anywhere. What we can do though is beam information about Kirk or Pickard or an apple or an insurance agent. We can beam a record of a patient, the status of an engine, a weather report. We can beam this information anywhere, to mobile workers, to field engineers, to a track loading apples, to ships crossing the Oceans, to web surfers. We have reached a point where the promise of information access anywhere and anytime is close to realization. The enabling technology, wireless networks, exists; what remains to be achieved is providing the infrastructure and the software to support the promise. Universal access and management of information has been one of the driving forces in the evolution of computer technology. Central computing gave the ability to perform large and complex computations and advanced information manipulation. Advances in networking connected computers together and led to distributed computing. Web technology and the Internet went even further to provide hyper-linked information access and global computing. However, restricting access stations to physical location limits the boundary of the vision.

In-Memory Data Management

In-Memory Data Management
Author: Hasso Plattner
Publisher: Springer Science & Business Media
Total Pages: 245
Release: 2011-03-08
Genre: Business & Economics
ISBN: 3642193633

In the last 50 years the world has been completely transformed through the use of IT. We have now reached a new inflection point. Here we present, for the first time, how in-memory computing is changing the way businesses are run. Today, enterprise data is split into separate databases for performance reasons. Analytical data resides in warehouses, synchronized periodically with transactional systems. This separation makes flexible, real-time reporting on current data impossible. Multi-core CPUs, large main memories, cloud computing and powerful mobile devices are serving as the foundation for the transition of enterprises away from this restrictive model. We describe techniques that allow analytical and transactional processing at the speed of thought and enable new ways of doing business. The book is intended for university students, IT-professionals and IT-managers, but also for senior management who wish to create new business processes by leveraging in-memory computing.

Main Memory Management on Relational Database Systems

Main Memory Management on Relational Database Systems
Author: Pedro Mejia Alvarez
Publisher: Springer Nature
Total Pages: 115
Release: 2022-09-13
Genre: Computers
ISBN: 3031132955

This book provides basic knowledge about main memory management in relational databases as it is needed to support large-scale applications processed completely in memory. In business operations, real-time predictability and high speed is a must. Hence every opportunity must be exploited to improve performance, including reducing dependency on the hard disk, adding more memory to make more data resident in the memory, and even deploying an in-memory system where all data can be kept in memory. The book provides one chapter for each of the main related topics, i.e. the memory system, memory management, virtual memory, and databases and their memory systems, and it is complemented by a short survey of six commercial systems: TimesTen, MySQL, VoltDB, Hekaton, HyPer/ScyPer, and SAP HANA.

35 IBPS RRB Officer Scale 1 & Office Assistant Prelim & Main Previous Year-wise Solved Papers (2013 - 2023) 5th Edition

35 IBPS RRB Officer Scale 1 & Office Assistant Prelim & Main Previous Year-wise Solved Papers (2013 - 2023) 5th Edition
Author: Disha Experts
Publisher: Disha Publications
Total Pages: 618
Release: 2024-04-03
Genre:
ISBN: 8119181867

The updated 5th edition of the book “35 IBPS RRB Officer Scale 1 & Office Assistant Prelim & Main Year-wise Solved Papers (2013-23)”. # This book contains 35 previous year Solved Papers from 2013 to 2023 of Preliminary and Main exams of the Officer Scale 1 & Office Assistant Exams. # Each Paper covers Reasoning Ability, Quantitative Aptitude, English Language, Computer Awareness and General Awareness. # Out of 35 Solved Papers - 18 Solved Papers (2013 - 2023) of IBPS RRB Officer Scale 1 and 17 Solved Papers (2015 - 2023) of IBPS RRB Office Assistant (Multipurpose) exams are provided. # The solutions provided in the book are very well explained, easy to understand and detailed. # The book is useful for students who are appearing for IBPS RRB Office Assistant (Multipurpose) and IBPS RRB Officer Scale 1 Exams. # The strength of the book lies in the originality of its question papers and Errorless Solutions. # The solution of each and every question is provided in detail (step-by-step) so as to provide 100% concept clarity to the students.

Data Storage

Data Storage
Author: Florin Balasa
Publisher: IntechOpen
Total Pages: 0
Release: 2010-04-01
Genre: Computers
ISBN: 9789533070636

The book presents several advances in different research areas related to data storage, from the design of a hierarchical memory subsystem in embedded signal processing systems for data-intensive applications, through data representation in flash memories, data recording and retrieval in conventional optical data storage systems and the more recent holographic systems, to applications in medicine requiring massive image databases.