Skip to Main content Skip to Navigation

Towards more scalability and flexibility for distributed storage systems

Abstract : The exponentially growing demand for storage puts a huge stress on traditionnal distributed storage systems. While storage devices' performance have caught up with network devices in the last decade, their capacity do not grow as fast as the rate of data growth, especially with the rise of cloud big data applications. Furthermore, the performance balance between storage, network and compute devices has shifted and the assumptions that are the foundation for most distributed storage systems are not true anymore. This dissertation explains how several aspects of such storage systems can be modified and rethought to make a more efficient use of the resource at their disposal. It presents an original architecture that uses a distributed layer of metadata to provide flexible and scalable object-level storage, then proposes a scheduling algorithm improving how a generic storage system handles concurrent requests. Finally, it describes how to improve legacy filesystem-level caching for erasure-code-based distributed storage systems, before presenting a few other contributions made in the context of short research projects.
Complete list of metadata

Cited literature [234 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Thursday, May 2, 2019 - 4:23:10 PM
Last modification on : Saturday, June 25, 2022 - 9:12:37 PM
Long-term archiving on: : Monday, September 30, 2019 - 9:32:14 PM


Version validated by the jury (STAR)


  • HAL Id : tel-02117812, version 1


Guillaume Ruty. Towards more scalability and flexibility for distributed storage systems. Distributed, Parallel, and Cluster Computing [cs.DC]. Université Paris-Saclay, 2019. English. ⟨NNT : 2019SACLT006⟩. ⟨tel-02117812⟩



Record views


Files downloads