A Bayesian Approach to Feature Selection in Classification Problems
A Master of Science thesis in Mathematics by Maher Emarly entitled, “A Bayesian Approach to Feature Selection in Classification Problems”, submitted in July 2024. Thesis advisor is Dr. Ayman Alzaatreh. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS Archives Cons...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| التنسيق: | doctoralThesis |
| منشور في: |
2024
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | https://hdl.handle.net/11073/25718 |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513438036787200 |
|---|---|
| author | Emarly, Maher |
| author_facet | Emarly, Maher |
| author_role | author |
| dc.contributor.none.fl_str_mv | Alzaatreh, Ayman |
| dc.creator.none.fl_str_mv | Emarly, Maher |
| dc.date.none.fl_str_mv | 2024-11-19T06:12:28Z 2024-11-19T06:12:28Z 2024-07 |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | 29.232-2024.06 https://hdl.handle.net/11073/25718 |
| dc.language.none.fl_str_mv | en_US |
| dc.subject.none.fl_str_mv | Bayesian statistics Relative belief ratio Feature selection Filter method Kullback-Leibler divergence |
| dc.title.none.fl_str_mv | A Bayesian Approach to Feature Selection in Classification Problems |
| dc.type.none.fl_str_mv | info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/doctoralThesis |
| description | A Master of Science thesis in Mathematics by Maher Emarly entitled, “A Bayesian Approach to Feature Selection in Classification Problems”, submitted in July 2024. Thesis advisor is Dr. Ayman Alzaatreh. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS Archives Consent Form). |
| format | doctoralThesis |
| id | aus_ceb8fb6eaeb6b863830f21062a05ad97 |
| identifier_str_mv | 29.232-2024.06 |
| language_invalid_str_mv | en_US |
| network_acronym_str | aus |
| network_name_str | aus |
| oai_identifier_str | oai:repository.aus.edu:11073/25718 |
| publishDate | 2024 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | A Bayesian Approach to Feature Selection in Classification ProblemsEmarly, MaherBayesian statisticsRelative belief ratioFeature selectionFilter methodKullback-Leibler divergenceA Master of Science thesis in Mathematics by Maher Emarly entitled, “A Bayesian Approach to Feature Selection in Classification Problems”, submitted in July 2024. Thesis advisor is Dr. Ayman Alzaatreh. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS Archives Consent Form).The exponential growth of data, as well as the widespread use of machine learning in daily life, demonstrate the importance of feature selection. Feature selection, defined as the process of identifying and selecting a subset of relevant features from a larger set of available features, is a crucial step in machine learning. The performance and efficiency of machine learning models are improved by focusing on the most informative features and eliminating unnecessary or redundant ones. Furthermore, model interpretability is enhanced, resulting in clearer insights and an actionable understanding of the results. The resulting models are more robust, less prone to noise, and can be efficiently trained and deployed, ultimately contributing to more effective and efficient data-driven decision-making processes. We propose a Bayesian approach using the relative belief ratio (RBR) as a filter method in this paper. The proposed method showed an excellent performance in binary and multiclass classification problems. In addition, the proposed method generates a strength value that can be used as an importance score for each feature. The numerical value of the strength of the RBR is used to rank the features. This method aims to discern the relative importance of features concerning a target variable and test for their significance. The proposed method’s performance is evaluated using both synthetic and real-world datasets, and it is compared to various popular filter methods.College of Arts and SciencesDepartment of Mathematics and StatisticsMaster of Science in Mathematics (MSMTH)Alzaatreh, Ayman2024-11-19T06:12:28Z2024-11-19T06:12:28Z2024-07info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdf29.232-2024.06https://hdl.handle.net/11073/25718en_USoai:repository.aus.edu:11073/257182025-11-11T07:05:36Z |
| spellingShingle | A Bayesian Approach to Feature Selection in Classification Problems Emarly, Maher Bayesian statistics Relative belief ratio Feature selection Filter method Kullback-Leibler divergence |
| status_str | publishedVersion |
| title | A Bayesian Approach to Feature Selection in Classification Problems |
| title_full | A Bayesian Approach to Feature Selection in Classification Problems |
| title_fullStr | A Bayesian Approach to Feature Selection in Classification Problems |
| title_full_unstemmed | A Bayesian Approach to Feature Selection in Classification Problems |
| title_short | A Bayesian Approach to Feature Selection in Classification Problems |
| title_sort | A Bayesian Approach to Feature Selection in Classification Problems |
| topic | Bayesian statistics Relative belief ratio Feature selection Filter method Kullback-Leibler divergence |
| url | https://hdl.handle.net/11073/25718 |