Low-Light Image Enhancement for Object Classification using Deep Learning
Low-light image (LLI) enhancement is an important image processing task that aims at improving the illumination of images taken under low-light conditions. Recently, a remarkable progress has been made in utilizing deep learning (DL) approaches for LLI enhancement. In this thesis, we perform a conci...
Saved in:
| Main Author: | |
|---|---|
| Format: | masterThesis |
| Published: |
2021
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/10725/13703 https://doi.org/10.26756/th.2022.211 http://libraries.lau.edu.lb/research/laur/terms-of-use/thesis.php |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1864513467878211584 |
|---|---|
| author | Al Sobbahi, Rayan |
| author_facet | Al Sobbahi, Rayan |
| author_role | author |
| dc.creator.none.fl_str_mv | Al Sobbahi, Rayan |
| dc.date.none.fl_str_mv | 2021 2021-05-11 2022-06-16T07:55:54Z 2022-06-16T07:55:54Z |
| dc.identifier.none.fl_str_mv | http://hdl.handle.net/10725/13703 https://doi.org/10.26756/th.2022.211 http://libraries.lau.edu.lb/research/laur/terms-of-use/thesis.php |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | Lebanese American University |
| dc.rights.*.fl_str_mv | info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Image processing Image processing -- Digital techniques Detectors Electrical engineering Lebanese American University -- Dissertations Dissertations, Academic |
| dc.title.none.fl_str_mv | Low-Light Image Enhancement for Object Classification using Deep Learning |
| dc.type.none.fl_str_mv | Thesis info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/masterThesis |
| description | Low-light image (LLI) enhancement is an important image processing task that aims at improving the illumination of images taken under low-light conditions. Recently, a remarkable progress has been made in utilizing deep learning (DL) approaches for LLI enhancement. In this thesis, we perform a concise and comprehensive review and comparative study of the most recent DL models used for LLI enhancement. We address LLI enhancement in two ways: i) standalone, as a separate task, and ii) end-to-end, as a pre-processing stage embedded within another high-level computer vision task, namely object detection and classification. We also conduct a feature analysis of DL feature maps extracted from normal, low-light, and enhanced images, and perform the occlusion experiment to better understand the effect of enhancement on object detection and classification. We then address a common problem of these models depicted by their design as standalone solutions without focusing on the impact of enhancement on high-level computer vision tasks like object classification. Our review and empirical evaluations show that enhancing LLI visual quality does not necessarily correlate with improved object detection and classification performance, and may even deteriorate it, especially in cases where enhanced images include extreme artifacts. To solve the problem, we propose a new LLI enhancement model that performs image-to-frequency filter learning and is designed for seamless integration into classification models. Through this integration, the classification model is embedded with an internal enhancement capability and is jointly trained to optimize both enhancement and classification performance. We conduct a large battery of experiments involving 76 testers to evaluate our approach’s LLI enhancement quality. When evaluated as a standalone enhancement model, our solution consistently ranks first or second among five state of the art enhancement techniques both quantitatively and qualitatively. When embedded with a classification model, our solution achieves an average of 5.5% improvement in classification accuracy, compared with the traditional pipeline of separate enhancement followed by classification. Results clearly produce robust classification performance on both low light and normal light images. |
| eu_rights_str_mv | openAccess |
| format | masterThesis |
| id | LAURepo_e91a3bf219a10386b5863a2e8da4c314 |
| language_invalid_str_mv | en |
| network_acronym_str | LAURepo |
| network_name_str | Lebanese American University repository |
| oai_identifier_str | oai:laur.lau.edu.lb:10725/13703 |
| publishDate | 2021 |
| publisher.none.fl_str_mv | Lebanese American University |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | Low-Light Image Enhancement for Object Classification using Deep LearningAl Sobbahi, RayanImage processingImage processing -- Digital techniquesDetectorsElectrical engineeringLebanese American University -- DissertationsDissertations, AcademicLow-light image (LLI) enhancement is an important image processing task that aims at improving the illumination of images taken under low-light conditions. Recently, a remarkable progress has been made in utilizing deep learning (DL) approaches for LLI enhancement. In this thesis, we perform a concise and comprehensive review and comparative study of the most recent DL models used for LLI enhancement. We address LLI enhancement in two ways: i) standalone, as a separate task, and ii) end-to-end, as a pre-processing stage embedded within another high-level computer vision task, namely object detection and classification. We also conduct a feature analysis of DL feature maps extracted from normal, low-light, and enhanced images, and perform the occlusion experiment to better understand the effect of enhancement on object detection and classification. We then address a common problem of these models depicted by their design as standalone solutions without focusing on the impact of enhancement on high-level computer vision tasks like object classification. Our review and empirical evaluations show that enhancing LLI visual quality does not necessarily correlate with improved object detection and classification performance, and may even deteriorate it, especially in cases where enhanced images include extreme artifacts. To solve the problem, we propose a new LLI enhancement model that performs image-to-frequency filter learning and is designed for seamless integration into classification models. Through this integration, the classification model is embedded with an internal enhancement capability and is jointly trained to optimize both enhancement and classification performance. We conduct a large battery of experiments involving 76 testers to evaluate our approach’s LLI enhancement quality. When evaluated as a standalone enhancement model, our solution consistently ranks first or second among five state of the art enhancement techniques both quantitatively and qualitatively. When embedded with a classification model, our solution achieves an average of 5.5% improvement in classification accuracy, compared with the traditional pipeline of separate enhancement followed by classification. Results clearly produce robust classification performance on both low light and normal light images.1 online resource (xiv, 100 leaves): col. ill.Includes bibliographical references (leaf 92-100)Lebanese American University2022-06-16T07:55:54Z2022-06-16T07:55:54Z20212021-05-11Thesisinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/masterThesishttp://hdl.handle.net/10725/13703https://doi.org/10.26756/th.2022.211http://libraries.lau.edu.lb/research/laur/terms-of-use/thesis.phpeninfo:eu-repo/semantics/openAccessoai:laur.lau.edu.lb:10725/137032023-05-10T08:29:43Z |
| spellingShingle | Low-Light Image Enhancement for Object Classification using Deep Learning Al Sobbahi, Rayan Image processing Image processing -- Digital techniques Detectors Electrical engineering Lebanese American University -- Dissertations Dissertations, Academic |
| status_str | publishedVersion |
| title | Low-Light Image Enhancement for Object Classification using Deep Learning |
| title_full | Low-Light Image Enhancement for Object Classification using Deep Learning |
| title_fullStr | Low-Light Image Enhancement for Object Classification using Deep Learning |
| title_full_unstemmed | Low-Light Image Enhancement for Object Classification using Deep Learning |
| title_short | Low-Light Image Enhancement for Object Classification using Deep Learning |
| title_sort | Low-Light Image Enhancement for Object Classification using Deep Learning |
| topic | Image processing Image processing -- Digital techniques Detectors Electrical engineering Lebanese American University -- Dissertations Dissertations, Academic |
| url | http://hdl.handle.net/10725/13703 https://doi.org/10.26756/th.2022.211 http://libraries.lau.edu.lb/research/laur/terms-of-use/thesis.php |