通信学报2017，Vol.38Issue(9)：18-24,7.DOI:10.11959/j.issn.1000-436x.2017178
基于Q-learning的HTTP自适应流码率控制方法研究
Research on Q-learning based rate control approach for HTTP adaptive streaming
摘要
Abstract
HTTP adaptive streaming (HAS) has become the standard for adaptive video streaming service. In changing network environments, current hardcoded-based rate adaptation algorithm was less flexible, and it is insufficient to con-sider the quality of experience (QoE). To optimize the QoE of users, a rate control approach based on Q-learning strategy was proposed. the client environments of HTTP adaptive video streaming was modeled and the state transition rule was defined. Three parameters related to QoE were quantified and a novel reward function was constructed. The experiments were employed by the Q-learning rate control approach in two typical HAS algorithms. The experiments show the rate control approach can enhance the stability of rate switching in HAS clients.关键词
HTTP自适应流/硬编码/Q学习/码率控制/稳定性Key words
HTTP adaptive streaming/hardcoded/Q-learning/rate control/stability分类
信息技术与安全科学引用本文复制引用
熊丽荣,雷静之,金鑫..基于Q-learning的HTTP自适应流码率控制方法研究[J].通信学报,2017,38(9):18-24,7.基金项目
浙江省重大科技专项重大工业基金资助项目( No.2012C11026-2 ) （ No.2012C11026-2 ）
杭州市重大科技创新专项基金资助项目(No.20132011A16) The Key Project of Science and Technology Planning Project of Zhejiang Province (No.2012C11026-2), The Special Found for Science and Technology Innovation Program of Hangzhou (No.20132011A16) （No.20132011A16）
