Optimizing HTTP-Based Adaptive Streaming in Vehicular Environment using Markov Decision Process

Select |


Bokani, Ayub; Hassan, Mahbub; Kanhere, Salil; Xiaoqing, Zhu


Journal Article

IEEE Transactions on Multimedia




Hypertext transfer protocol (HTTP) is the fundamental mechanics supporting web browsing on the Internet. An HTTP server stores large volumes of contents and delivers specific pieces to the clients when requested. There is a recent move to use HTTP for video streaming as well, which promises seamless integration of video delivery to existing HTTP-based server platforms. This is achieved by segmenting the video into many small chunks and storing these chunks as separate files on the server. For adaptive streaming, the server stores different quality versions of the same chunk in different files to allow real-time quality adaptation of the video due to network bandwidth variation experienced by a client. For each chunk of the video, which quality version to download, therefore, becomes a major decision-making challenge for the streaming client, especially in vehicular environment with significant uncertainty in mobile bandwidth. In this paper, we demonstrate that for such decision making, Markov decision process (MDP) is superior to previously proposed non-MDP solutions. Using publicly available video and bandwidth datasets, we show that MDP achieves up to 15x reduction in playback deadline miss compared to a well-known non-MDP solution when the MDP has the prior knowledge of the bandwidth model. We also consider a model-free MDP implementation that uses Q-learning to gradually learn the optimal decisions by continuously observing the outcome of its decision making. We find that MDP with Q-learning significantly outperforms MDP that uses bandwidth models.

Data61; NICTA; Dynamic Adaptive Streaming over HTTP; Video Streaming; Markov Decision Process




Bokani, Ayub; Hassan, Mahbub; Kanhere, Salil; Xiaoqing, Zhu. Optimizing HTTP-Based Adaptive Streaming in Vehicular Environment using Markov Decision Process. IEEE Transactions on Multimedia. 2015-11-13; 17(12):2297-2309. <a href="https://doi.org/10.1109/TMM.2015.2494458" target="_blank">https://doi.org/10.1109/TMM.2015.2494458</a>

Loading citation data...

Citation counts
(Requires subscription to view)