RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos
<p dir="ltr">With the advancement of rich media generating devices, the proliferation of live Content Providers (CP), and the availability of convenient internet access, crowdsourced live streaming services have witnessed unexpected growth. To ensure a better Quality of Experience (Q...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , , , , |
| Published: |
2020
|
| Subjects: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1864513558889365504 |
|---|---|
| author | Emna Baccour (16896366) |
| author2 | Aiman Erbad (14150589) Amr Mohamed (3508121) Fatima Haouari (17100181) Mohsen Guizani (12580291) Mounir Hamdi (14150652) |
| author2_role | author author author author author |
| author_facet | Emna Baccour (16896366) Aiman Erbad (14150589) Amr Mohamed (3508121) Fatima Haouari (17100181) Mohsen Guizani (12580291) Mounir Hamdi (14150652) |
| author_role | author |
| dc.creator.none.fl_str_mv | Emna Baccour (16896366) Aiman Erbad (14150589) Amr Mohamed (3508121) Fatima Haouari (17100181) Mohsen Guizani (12580291) Mounir Hamdi (14150652) |
| dc.date.none.fl_str_mv | 2020-11-01T00:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1016/j.future.2020.06.038 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/RL-OPRA_Reinforcement_Learning_for_Online_and_Proactive_Resource_Allocation_of_crowdsourced_live_videos/24249832 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Information and computing sciences Computer vision and multimedia computation Distributed computing and systems software Machine learning Live streaming QoE Geo-distributed clouds Machine and reinforcement learning |
| dc.title.none.fl_str_mv | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p dir="ltr">With the advancement of rich media generating devices, the proliferation of live Content Providers (CP), and the availability of convenient internet access, crowdsourced live streaming services have witnessed unexpected growth. To ensure a better Quality of Experience (QoE), higher availability, and lower costs, large live streaming CPs are migrating their services to geo-distributed cloud infrastructure. However, because of the dynamics of live broadcasting and the wide geo-distribution of viewers and broadcasters, it is still challenging to satisfy all requests with reasonable resources. To overcome this challenge, we introduce in this paper a prediction driven approach that estimates the potential number of viewers near different cloud sites at the instant of broadcasting. This online and instant prediction of distributed popularity distinguishes our work from previous efforts that provision constant resources or alter their allocation as the popularity of the content changes. Based on the derived predictions, we formulate an Integer-Linear Program (ILP) to proactively and dynamically choose the right data center to allocate exact resources and serve potential viewers, while minimizing the perceived delays. As the optimization is not adequate for online serving, we propose a real-time approach based on Reinforcement Learning (RL), namely RL-OPRA, which adaptively learns to optimize the allocation and serving decisions by interacting with the network environment. Extensive simulation and comparison with the ILP have shown that our RL-based approach is able to present optimal results compared to heuristic-based approaches.</p><h2>Other Information</h2><p dir="ltr">Published in: Future Generation Computer Systems<br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.future.2020.06.038" target="_blank">https://dx.doi.org/10.1016/j.future.2020.06.038</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_c3c9072302c977b248da11b59f519a5e |
| identifier_str_mv | 10.1016/j.future.2020.06.038 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/24249832 |
| publishDate | 2020 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videosEmna Baccour (16896366)Aiman Erbad (14150589)Amr Mohamed (3508121)Fatima Haouari (17100181)Mohsen Guizani (12580291)Mounir Hamdi (14150652)Information and computing sciencesComputer vision and multimedia computationDistributed computing and systems softwareMachine learningLive streamingQoEGeo-distributed cloudsMachine and reinforcement learning<p dir="ltr">With the advancement of rich media generating devices, the proliferation of live Content Providers (CP), and the availability of convenient internet access, crowdsourced live streaming services have witnessed unexpected growth. To ensure a better Quality of Experience (QoE), higher availability, and lower costs, large live streaming CPs are migrating their services to geo-distributed cloud infrastructure. However, because of the dynamics of live broadcasting and the wide geo-distribution of viewers and broadcasters, it is still challenging to satisfy all requests with reasonable resources. To overcome this challenge, we introduce in this paper a prediction driven approach that estimates the potential number of viewers near different cloud sites at the instant of broadcasting. This online and instant prediction of distributed popularity distinguishes our work from previous efforts that provision constant resources or alter their allocation as the popularity of the content changes. Based on the derived predictions, we formulate an Integer-Linear Program (ILP) to proactively and dynamically choose the right data center to allocate exact resources and serve potential viewers, while minimizing the perceived delays. As the optimization is not adequate for online serving, we propose a real-time approach based on Reinforcement Learning (RL), namely RL-OPRA, which adaptively learns to optimize the allocation and serving decisions by interacting with the network environment. Extensive simulation and comparison with the ILP have shown that our RL-based approach is able to present optimal results compared to heuristic-based approaches.</p><h2>Other Information</h2><p dir="ltr">Published in: Future Generation Computer Systems<br>License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.future.2020.06.038" target="_blank">https://dx.doi.org/10.1016/j.future.2020.06.038</a></p>2020-11-01T00:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1016/j.future.2020.06.038https://figshare.com/articles/journal_contribution/RL-OPRA_Reinforcement_Learning_for_Online_and_Proactive_Resource_Allocation_of_crowdsourced_live_videos/24249832CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/242498322020-11-01T00:00:00Z |
| spellingShingle | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos Emna Baccour (16896366) Information and computing sciences Computer vision and multimedia computation Distributed computing and systems software Machine learning Live streaming QoE Geo-distributed clouds Machine and reinforcement learning |
| status_str | publishedVersion |
| title | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos |
| title_full | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos |
| title_fullStr | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos |
| title_full_unstemmed | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos |
| title_short | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos |
| title_sort | RL-OPRA: Reinforcement Learning for Online and Proactive Resource Allocation of crowdsourced live videos |
| topic | Information and computing sciences Computer vision and multimedia computation Distributed computing and systems software Machine learning Live streaming QoE Geo-distributed clouds Machine and reinforcement learning |