Skip to Main content Skip to Navigation
New interface

Enhancing video applications through timed metadata

Abstract : Video recording devices are often equipped with sensors (smartphones for example, with GPS receiver, gyroscope etc.), or used in settings where sensors are present (e.g. monitor cameras, in areas with temperature and/or humidity sensors). As a result, many systems process and distribute video together with timed metadata streams, often sourced as User-Generated Content. Video delivery has been thoroughly studied, however timed metadata streams have varying characteristics and forms, thus a consistent and effective way to handle them in conjunction with the video streams does not exist. In this Thesis we study ways to enhance video applications through timed metadata. We define as timed metadata all the non-audiovisual data recorded or produced, that are relevant to a specific time on the media timeline. ”Enhancing” video applications has a double meaning, and this work consists of two respective parts. First, using the timed metadata to extend the capabilities of multimedia applications, by introducing novel functionalities. Second, using the timed metadata to improve the content delivery for such applications. To extend multimedia applications, we have taken an exploratory approach, and we demonstrate two use cases with application examples. In the first case, timed metadata is used as input for generating content, and in the second, it is used to extend the navigational capabilities for the underlying multimedia content. By designing and implementing two different application scenarios we were able to identify the potential and limitations of video systems with timed metadata. We use the findings from the first part, to work from the perspective of enhancing video applications, by using the timed metadata to improve delivery of the content. More specifically, we study the use of timed metadata for multi-variable adaptation in multi-view video delivery - and we test our proposals on one of the platforms developed previously. Our final contribution is a buffering scheme for synchronous and lowlatency playback in live streaming systems.
Complete list of metadata

Cited literature [130 references]  Display  Hide  Download
Contributor : ABES STAR :  Contact
Submitted on : Monday, February 17, 2020 - 5:43:30 PM
Last modification on : Saturday, June 25, 2022 - 10:48:59 AM
Long-term archiving on: : Monday, May 18, 2020 - 6:24:34 PM


Version validated by the jury (STAR)


  • HAL Id : tel-02481064, version 2



Emmanouil Potetsianakis. Enhancing video applications through timed metadata. Multimedia [cs.MM]. Université Paris-Saclay, 2019. English. ⟨NNT : 2019SACLT029⟩. ⟨tel-02481064v2⟩



Record views


Files downloads