← Back to Presentations
Oral Presentation

Design and Implementation of a Scalable Distributed Database System with LSM-tree Storage and Consistent Hashing

Speakers: CHANDRU M S, JAGAN KARTHICK A, MADHAN KUMAR S

Track: Others

📑 No Slides 🎬 No Video

Abstract

This paper explains the full scope, the intricate details, and the result of the evaluation of a novel distributed database system that combines a Log-Structured Merge-tree (LSM-tree) storage structure with consistent hashing for the best data distribution and retrieval in a way that they complement each other. To begin with, the system that we have designed addresses the problems that have become the major challenges of the data-intensive applications that consume large amounts of data. It supports a great throughput of write operations while also preserving a strong read performance and fault tolerance. The architecture utilizes a fundamentally new ring-based topology with the automatic replication of data, the efficient mechanisms of secondary indexing, and the advanced memory management with the help of the intelligent memtable flushing. The result of a broad range of experiments confirms the high performance of our system in that it can achieve 45,231 operations/second write throughput, and this is a 17.6% betterment of Apache Cassandra and a 266% betterment of MongoDB. Under the test environment, the system shows linear scalability up to 12 nodes, and it is consistent that sub-millisecond latency is achieved for 95% of the read operations.

Speakers

CHANDRU M S
STUDENT
SRM Institute of Science and Technology *
JAGAN KARTHICK A
STUDENT
SRM Institute of Science and Technology *
MADHAN KUMAR S
STUDENT
SRM Institute of Science and Technology *

Details

Type
Oral Presentation
Model
OFFLINE
Language
EN
Timezone
UTC+8
Views
324
Likes
22