Towards more scalability and flexibility for distributed storage systems

Abstract : The exponentially growing demand for storage puts a huge stress on traditionnal distributed storage systems. While storage devices' performance have caught up with network devices in the last decade, their capacity do not grow as fast as the rate of data growth, especially with the rise of cloud big data applications. Furthermore, the performance balance between storage, network and compute devices has shifted and the assumptions that are the foundation for most distributed storage systems are not true anymore. This dissertation explains how several aspects of such storage systems can be modified and rethought to make a more efficient use of the resource at their disposal. It presents an original architecture that uses a distributed layer of metadata to provide flexible and scalable object-level storage, then proposes a scheduling algorithm improving how a generic storage system handles concurrent requests. Finally, it describes how to improve legacy filesystem-level caching for erasure-code-based distributed storage systems, before presenting a few other contributions made in the context of short research projects.
Complete list of metadatas

Cited literature [194 references]  Display  Hide  Download

https://pastel.archives-ouvertes.fr/tel-02117812
Contributor : Abes Star <>
Submitted on : Thursday, May 2, 2019 - 4:23:10 PM
Last modification on : Wednesday, July 3, 2019 - 3:02:03 PM

File

77777_RUTY_2019_archivage.pdf
Version validated by the jury (STAR)

Identifiers

  • HAL Id : tel-02117812, version 1

Citation

Guillaume Ruty. Towards more scalability and flexibility for distributed storage systems. Distributed, Parallel, and Cluster Computing [cs.DC]. Université Paris-Saclay, 2019. English. ⟨NNT : 2019SACLT006⟩. ⟨tel-02117812⟩

Share

Metrics

Record views

164

Files downloads

129