Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone
Over the last decade, videos uploaded and shared through web-based multimedia platforms and mobile applications have proliferated worldwide. This is because cloud-based applications such as iCloud, YouTube, Facebook, Twitter, and WhatsApp offer affordable and secure environments for video storage an...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , , , |
| Format: | article |
| Published: |
2023
|
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1016/j.eswa.2023.121603 https://www.sciencedirect.com/science/article/pii/S095741742302105X http://hdl.handle.net/10576/49644 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1857415085933199360 |
|---|---|
| author | Younes, Akbari |
| author2 | Al Maadeed, Somaya Elharrouss, Omar Ottakath, Najmath Khelifi, Fouad |
| author2_role | author author author author |
| author_facet | Younes, Akbari Al Maadeed, Somaya Elharrouss, Omar Ottakath, Najmath Khelifi, Fouad |
| author_role | author |
| dc.creator.none.fl_str_mv | Younes, Akbari Al Maadeed, Somaya Elharrouss, Omar Ottakath, Najmath Khelifi, Fouad |
| dc.date.none.fl_str_mv | 2023-11-25T21:41:18Z 2024-03-15 |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | http://dx.doi.org/10.1016/j.eswa.2023.121603 Akbari, Y., Al Maadeed, S., Elharrouss, O., Ottakath, N., & Khelifi, F. (2024). Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone. Expert Systems with Applications, 238, 121603. 09574174 https://www.sciencedirect.com/science/article/pii/S095741742302105X http://hdl.handle.net/10576/49644 238 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | Elsevier |
| dc.rights.none.fl_str_mv | http://creativecommons.org/licenses/by/4.0/ info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Source model camera identification Video Hierarchical deep learning Fusion layer Joint sparse representation |
| dc.title.none.fl_str_mv | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| dc.type.none.fl_str_mv | Article info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/article |
| description | Over the last decade, videos uploaded and shared through web-based multimedia platforms and mobile applications have proliferated worldwide. This is because cloud-based applications such as iCloud, YouTube, Facebook, Twitter, and WhatsApp offer affordable and secure environments for video storage and sharing. However, new challenges have emerged alarming forensic analysts and investigators since videos can be used to commit heinous crimes such as blackmail, fraud, and forgery. Source Camera Identification (SCI) has become of paramount importance in the field of image and video forensics. Camera model identification can also help identify the perpetrators or narrow down the search and can be used to enhance SCI systems. In this context, existing approaches such as the Photo Response Non-Uniformity (PRNU) based methods and machine learning techniques such as the support vector machine (SVM) and deep learning models are commonly used solutions. This work exploits these two categories of methods by exploring a hierarchical deep learning model for camera model identification based on smartphone videos. The PRNU features are extracted by CNN-based structures during the training process. Proposed six-stream networks are leveraged to extract both low-level and high-level features through the network. A fusion layer is created based on joint sparse representation using forward and backward functions defined for fusing the proposed six streams. The proposed approach has been implemented and evaluated through intensive experiments, and results showed successful camera model identification with a performance at the frame level reaching an average accuracy of 69.9% for the Daxing dataset and 81.6% for the QUFVD dataset. |
| eu_rights_str_mv | openAccess |
| format | article |
| id | qu_73e42079f81ed5ec86945d09d93d1ead |
| identifier_str_mv | Akbari, Y., Al Maadeed, S., Elharrouss, O., Ottakath, N., & Khelifi, F. (2024). Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone. Expert Systems with Applications, 238, 121603. 09574174 238 |
| language_invalid_str_mv | en |
| network_acronym_str | qu |
| network_name_str | Qatar University repository |
| oai_identifier_str | oai:qspace.qu.edu.qa:10576/49644 |
| publishDate | 2023 |
| publisher.none.fl_str_mv | Elsevier |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | http://creativecommons.org/licenses/by/4.0/ |
| spelling | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphoneYounes, AkbariAl Maadeed, SomayaElharrouss, OmarOttakath, NajmathKhelifi, FouadSource model camera identificationVideoHierarchical deep learningFusion layerJoint sparse representationOver the last decade, videos uploaded and shared through web-based multimedia platforms and mobile applications have proliferated worldwide. This is because cloud-based applications such as iCloud, YouTube, Facebook, Twitter, and WhatsApp offer affordable and secure environments for video storage and sharing. However, new challenges have emerged alarming forensic analysts and investigators since videos can be used to commit heinous crimes such as blackmail, fraud, and forgery. Source Camera Identification (SCI) has become of paramount importance in the field of image and video forensics. Camera model identification can also help identify the perpetrators or narrow down the search and can be used to enhance SCI systems. In this context, existing approaches such as the Photo Response Non-Uniformity (PRNU) based methods and machine learning techniques such as the support vector machine (SVM) and deep learning models are commonly used solutions. This work exploits these two categories of methods by exploring a hierarchical deep learning model for camera model identification based on smartphone videos. The PRNU features are extracted by CNN-based structures during the training process. Proposed six-stream networks are leveraged to extract both low-level and high-level features through the network. A fusion layer is created based on joint sparse representation using forward and backward functions defined for fusing the proposed six streams. The proposed approach has been implemented and evaluated through intensive experiments, and results showed successful camera model identification with a performance at the frame level reaching an average accuracy of 69.9% for the Daxing dataset and 81.6% for the QUFVD dataset.This publication was made possible by NPRP, Qatar grant # NPRP12S-0312-190332 from Qatar National Research Fund (a member of Qatar Foundation). The statement made herein are solely the responsibility of the authors.Elsevier2023-11-25T21:41:18Z2024-03-15Articleinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://dx.doi.org/10.1016/j.eswa.2023.121603Akbari, Y., Al Maadeed, S., Elharrouss, O., Ottakath, N., & Khelifi, F. (2024). Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone. Expert Systems with Applications, 238, 121603.09574174https://www.sciencedirect.com/science/article/pii/S095741742302105Xhttp://hdl.handle.net/10576/49644238enhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:qspace.qu.edu.qa:10576/496442024-07-23T15:52:04Z |
| spellingShingle | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone Younes, Akbari Source model camera identification Video Hierarchical deep learning Fusion layer Joint sparse representation |
| status_str | publishedVersion |
| title | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_full | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_fullStr | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_full_unstemmed | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_short | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| title_sort | Hierarchical deep learning approach using fusion layer for Source Camera Model Identification based on video taken by smartphone |
| topic | Source model camera identification Video Hierarchical deep learning Fusion layer Joint sparse representation |
| url | http://dx.doi.org/10.1016/j.eswa.2023.121603 https://www.sciencedirect.com/science/article/pii/S095741742302105X http://hdl.handle.net/10576/49644 |