System architecture design for high performance solid-state data storage devices
Loading...
Authors
Chen, Xubin
Issue Date
2020-08
Type
Electronic thesis
Thesis
Thesis
Language
ENG
Keywords
Computer Systems engineering
Alternative Title
Abstract
Therefore, this thesis focuses on mitigating the impact of compaction while keeping the data structures and algorithms in existing KV stores completely intact. Instead of directly reducing the write amplification, this thesis applies the simple memory/storage tiering concept to mitigate the impact of compaction at the cost of larger write-ahead log (WAL) and host memory capacity usage. This thesis presents design approaches to effectively reduce the WAL size and memory cost. This thesis integrates the developed solution into RocksDB by only adding about 1,200 lines of code, without touching its core data structure and algorithm. Using 100GB and 1TB datasets as test vehicles, this thesis carries out experiments with db bench and YCSB workloads, and the results show that the modified RocksDB can improve the ops/s by up to 100.7% and meanwhile reduce the 99-percentile tail latency by up to 82%.
Description
August 2020
School of Engineering
School of Engineering
Full Citation
Publisher
Rensselaer Polytechnic Institute, Troy, NY