A Model for the Automatic Mixing of Multiple Audio and Video Clips
Short-form videos are becoming a trend in today’s social media. A large number of tools provide users with the capability to edit and mix video clips with audio files to create a short-form video. A significant number of such videos currently exist on platforms such as TikTok and Instagram that were...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , |
| التنسيق: | conferenceObject |
| منشور في: |
2023
|
| الوصول للمادة أونلاين: | http://hdl.handle.net/10725/15396 https://doi.org/10.1109/CW58918.2023.00025 http://libraries.lau.edu.lb/research/laur/terms-of-use/articles.php https://ieeexplore.ieee.org/abstract/document/10337600 |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513470533206016 |
|---|---|
| author | Hedna, Mohamed Rissal |
| author2 | Djemmal, Younes Mershad, Khaleel |
| author2_role | author author |
| author_facet | Hedna, Mohamed Rissal Djemmal, Younes Mershad, Khaleel |
| author_role | author |
| dc.creator.none.fl_str_mv | Hedna, Mohamed Rissal Djemmal, Younes Mershad, Khaleel |
| dc.date.none.fl_str_mv | 2023 2023-12-06 2024-03-08T14:40:28Z 2024-03-08T14:40:28Z |
| dc.identifier.none.fl_str_mv | 9798350315660 http://hdl.handle.net/10725/15396 https://doi.org/10.1109/CW58918.2023.00025 Hedna, M. R., Djemmal, Y., & Mershad, K. (2023, October). A Model for the Automatic Mixing of Multiple Audio and Video Clips. In 2023 International Conference on Cyberworlds (CW) (pp. 110-117). IEEE. http://libraries.lau.edu.lb/research/laur/terms-of-use/articles.php https://ieeexplore.ieee.org/abstract/document/10337600 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | IEEE |
| dc.rights.*.fl_str_mv | info:eu-repo/semantics/openAccess |
| dc.title.none.fl_str_mv | A Model for the Automatic Mixing of Multiple Audio and Video Clips |
| dc.type.none.fl_str_mv | Conference Paper / Proceeding info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/conferenceObject |
| description | Short-form videos are becoming a trend in today’s social media. A large number of tools provide users with the capability to edit and mix video clips with audio files to create a short-form video. A significant number of such videos currently exist on platforms such as TikTok and Instagram that were created by manual cut and mix of video and audio clips. In this paper, we examine the relationship that exists between video scenes and audio clips in order to identify the best mixing strategy of multiple video and audio files. For this purpose, we extract the beats and downbeats of the audio files and augment them with the scene changes in the video files. Next, we use the data to train two LSTM and RNN models to determine the best places to cut the video based on the audio data. Our system enables users to automatically create high-quality short-form videos by simply specifying the video clips and the audio file that should be mixed with them. We conducted experiments on 200 short-form videos. Our results illustrate the efficiency of the proposed system in determining the optimal cut scenes based on the characteristics of the selected audio file. |
| eu_rights_str_mv | openAccess |
| format | conferenceObject |
| id | LAURepo_5bb73ef8c41bc8f680167ba5bff5c3ea |
| identifier_str_mv | 9798350315660 Hedna, M. R., Djemmal, Y., & Mershad, K. (2023, October). A Model for the Automatic Mixing of Multiple Audio and Video Clips. In 2023 International Conference on Cyberworlds (CW) (pp. 110-117). IEEE. |
| language_invalid_str_mv | en |
| network_acronym_str | LAURepo |
| network_name_str | Lebanese American University repository |
| oai_identifier_str | oai:laur.lau.edu.lb:10725/15396 |
| publishDate | 2023 |
| publisher.none.fl_str_mv | IEEE |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | A Model for the Automatic Mixing of Multiple Audio and Video ClipsHedna, Mohamed RissalDjemmal, YounesMershad, KhaleelShort-form videos are becoming a trend in today’s social media. A large number of tools provide users with the capability to edit and mix video clips with audio files to create a short-form video. A significant number of such videos currently exist on platforms such as TikTok and Instagram that were created by manual cut and mix of video and audio clips. In this paper, we examine the relationship that exists between video scenes and audio clips in order to identify the best mixing strategy of multiple video and audio files. For this purpose, we extract the beats and downbeats of the audio files and augment them with the scene changes in the video files. Next, we use the data to train two LSTM and RNN models to determine the best places to cut the video based on the audio data. Our system enables users to automatically create high-quality short-form videos by simply specifying the video clips and the audio file that should be mixed with them. We conducted experiments on 200 short-form videos. Our results illustrate the efficiency of the proposed system in determining the optimal cut scenes based on the characteristics of the selected audio file.Includes bibliographical references.IEEE2024-03-08T14:40:28Z2024-03-08T14:40:28Z20232023-12-06Conference Paper / Proceedinginfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/conferenceObject9798350315660http://hdl.handle.net/10725/15396https://doi.org/10.1109/CW58918.2023.00025Hedna, M. R., Djemmal, Y., & Mershad, K. (2023, October). A Model for the Automatic Mixing of Multiple Audio and Video Clips. In 2023 International Conference on Cyberworlds (CW) (pp. 110-117). IEEE.http://libraries.lau.edu.lb/research/laur/terms-of-use/articles.phphttps://ieeexplore.ieee.org/abstract/document/10337600eninfo:eu-repo/semantics/openAccessoai:laur.lau.edu.lb:10725/153962024-07-03T08:17:06Z |
| spellingShingle | A Model for the Automatic Mixing of Multiple Audio and Video Clips Hedna, Mohamed Rissal |
| status_str | publishedVersion |
| title | A Model for the Automatic Mixing of Multiple Audio and Video Clips |
| title_full | A Model for the Automatic Mixing of Multiple Audio and Video Clips |
| title_fullStr | A Model for the Automatic Mixing of Multiple Audio and Video Clips |
| title_full_unstemmed | A Model for the Automatic Mixing of Multiple Audio and Video Clips |
| title_short | A Model for the Automatic Mixing of Multiple Audio and Video Clips |
| title_sort | A Model for the Automatic Mixing of Multiple Audio and Video Clips |
| url | http://hdl.handle.net/10725/15396 https://doi.org/10.1109/CW58918.2023.00025 http://libraries.lau.edu.lb/research/laur/terms-of-use/articles.php https://ieeexplore.ieee.org/abstract/document/10337600 |