Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone
<p>Over the last decade, videos uploaded and shared through web-based multimedia platforms and mobile applications have proliferated worldwide. This is because cloud-based applications such as iCloud, YouTube, Facebook, Twitter, and WhatsApp offer affordable and secure environments for video s...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , , , |
| Published: |
2024
|
| Subjects: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1864513539479175168 |
|---|---|
| author | Younes Akbari (16303286) |
| author2 | Somaya Al Maadeed (14151420) Omar Elharrouss (14150784) Najmath Ottakath (17430912) Fouad Khelifi (16904778) |
| author2_role | author author author author |
| author_facet | Younes Akbari (16303286) Somaya Al Maadeed (14151420) Omar Elharrouss (14150784) Najmath Ottakath (17430912) Fouad Khelifi (16904778) |
| author_role | author |
| dc.creator.none.fl_str_mv | Younes Akbari (16303286) Somaya Al Maadeed (14151420) Omar Elharrouss (14150784) Najmath Ottakath (17430912) Fouad Khelifi (16904778) |
| dc.date.none.fl_str_mv | 2024-03-15T06:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1016/j.eswa.2023.121603 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Hierarchical_deep_learning_approach_using_fusion_layer_for_Source_Camera_Model_Identification_based_on_video_taken_by_smartphone/24607110 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Information and computing sciences Cybersecurity and privacy Machine learning Source model camera identification Video Hierarchical deep learning Fusion layer Joint sparse representation |
| dc.title.none.fl_str_mv | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p>Over the last decade, videos uploaded and shared through web-based multimedia platforms and mobile applications have proliferated worldwide. This is because cloud-based applications such as iCloud, YouTube, Facebook, Twitter, and WhatsApp offer affordable and secure environments for video storage and sharing. However, new challenges have emerged alarming forensic analysts and investigators since videos can be used to commit heinous crimes such as blackmail, fraud, and forgery. Source Camera Identification (SCI) has become of paramount importance in the field of image and video forensics. Camera model identification can also help identify the perpetrators or narrow down the search and can be used to enhance SCI systems. In this context, existing approaches such as the Photo Response Non-Uniformity (PRNU) based methods and machine learning techniques such as the support vector machine (SVM) and deep learning models are commonly used solutions. This work exploits these two categories of methods by exploring a hierarchical deep learning model for camera model identification based on smartphone videos. The PRNU features are extracted by CNN-based structures during the training process. Proposed six-stream networks are leveraged to extract both low-level and high-level features through the network. A fusion layer is created based on joint sparse representation using forward and backward functions defined for fusing the proposed six streams. The proposed approach has been implemented and evaluated through intensive experiments, and results showed successful camera model identification with a performance at the frame level reaching an average accuracy of 69.9% for the Daxing dataset and 81.6% for the QUFVD dataset.</p><h2>Other Information</h2> <p> Published in: Expert Systems with Applications<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.eswa.2023.121603" target="_blank">https://dx.doi.org/10.1016/j.eswa.2023.121603</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_7cdacc60ed9e3e5e5d64f52f1bc84958 |
| identifier_str_mv | 10.1016/j.eswa.2023.121603 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/24607110 |
| publishDate | 2024 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphoneYounes Akbari (16303286)Somaya Al Maadeed (14151420)Omar Elharrouss (14150784)Najmath Ottakath (17430912)Fouad Khelifi (16904778)Information and computing sciencesCybersecurity and privacyMachine learningSource model camera identificationVideoHierarchical deep learningFusion layerJoint sparse representation<p>Over the last decade, videos uploaded and shared through web-based multimedia platforms and mobile applications have proliferated worldwide. This is because cloud-based applications such as iCloud, YouTube, Facebook, Twitter, and WhatsApp offer affordable and secure environments for video storage and sharing. However, new challenges have emerged alarming forensic analysts and investigators since videos can be used to commit heinous crimes such as blackmail, fraud, and forgery. Source Camera Identification (SCI) has become of paramount importance in the field of image and video forensics. Camera model identification can also help identify the perpetrators or narrow down the search and can be used to enhance SCI systems. In this context, existing approaches such as the Photo Response Non-Uniformity (PRNU) based methods and machine learning techniques such as the support vector machine (SVM) and deep learning models are commonly used solutions. This work exploits these two categories of methods by exploring a hierarchical deep learning model for camera model identification based on smartphone videos. The PRNU features are extracted by CNN-based structures during the training process. Proposed six-stream networks are leveraged to extract both low-level and high-level features through the network. A fusion layer is created based on joint sparse representation using forward and backward functions defined for fusing the proposed six streams. The proposed approach has been implemented and evaluated through intensive experiments, and results showed successful camera model identification with a performance at the frame level reaching an average accuracy of 69.9% for the Daxing dataset and 81.6% for the QUFVD dataset.</p><h2>Other Information</h2> <p> Published in: Expert Systems with Applications<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.eswa.2023.121603" target="_blank">https://dx.doi.org/10.1016/j.eswa.2023.121603</a></p>2024-03-15T06:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1016/j.eswa.2023.121603https://figshare.com/articles/journal_contribution/Hierarchical_deep_learning_approach_using_fusion_layer_for_Source_Camera_Model_Identification_based_on_video_taken_by_smartphone/24607110CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/246071102024-03-15T06:00:00Z |
| spellingShingle | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone Younes Akbari (16303286) Information and computing sciences Cybersecurity and privacy Machine learning Source model camera identification Video Hierarchical deep learning Fusion layer Joint sparse representation |
| status_str | publishedVersion |
| title | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_full | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_fullStr | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_full_unstemmed | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_short | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_sort | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| topic | Information and computing sciences Cybersecurity and privacy Machine learning Source model camera identification Video Hierarchical deep learning Fusion layer Joint sparse representation |