Empirical Evaluation of Extended Finite State Machine Test Suites
A Master of Science thesis in Computer Engineering by Faiz Mohammed Hasan entitled, “Empirical Evaluation of Extended Finite State Machine Test Suites”, submitted in May 2022. Thesis advisor is Dr. Khaled El-Fakih. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| التنسيق: | doctoralThesis |
| منشور في: |
2022
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | http://hdl.handle.net/11073/24286 |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513442097922048 |
|---|---|
| author | Hasan, Faiz Mohammed |
| author_facet | Hasan, Faiz Mohammed |
| author_role | author |
| dc.contributor.none.fl_str_mv | El Fakih, Khaled |
| dc.creator.none.fl_str_mv | Hasan, Faiz Mohammed |
| dc.date.none.fl_str_mv | 2022-09-20T05:51:57Z 2022-09-20T05:51:57Z 2022-05 |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | 35.232-2022.26 http://hdl.handle.net/11073/24286 |
| dc.language.none.fl_str_mv | en_US |
| dc.subject.none.fl_str_mv | Software engineering/software/program verification Software engineering/testing and debugging Software engineering/test design Extended finite state machines W, HSI, and H methods Mutation scores Test assessment Fault coverage |
| dc.title.none.fl_str_mv | Empirical Evaluation of Extended Finite State Machine Test Suites |
| dc.type.none.fl_str_mv | info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/doctoralThesis |
| description | A Master of Science thesis in Computer Engineering by Faiz Mohammed Hasan entitled, “Empirical Evaluation of Extended Finite State Machine Test Suites”, submitted in May 2022. Thesis advisor is Dr. Khaled El-Fakih. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS Archives Consent Form). |
| format | doctoralThesis |
| id | aus_8a12a4f5cc1e5a4dfffc3d6f56abb9eb |
| identifier_str_mv | 35.232-2022.26 |
| language_invalid_str_mv | en_US |
| network_acronym_str | aus |
| network_name_str | aus |
| oai_identifier_str | oai:repository.aus.edu:11073/24286 |
| publishDate | 2022 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | Empirical Evaluation of Extended Finite State Machine Test SuitesHasan, Faiz MohammedSoftware engineering/software/program verificationSoftware engineering/testing and debuggingSoftware engineering/test designExtended finite state machinesW, HSI, and H methodsMutation scoresTest assessmentFault coverageA Master of Science thesis in Computer Engineering by Faiz Mohammed Hasan entitled, “Empirical Evaluation of Extended Finite State Machine Test Suites”, submitted in May 2022. Thesis advisor is Dr. Khaled El-Fakih. Soft copy is available (Thesis, Completion Certificate, Approval Signatures, and AUS Archives Consent Form).We present novel empirical assessments of prominent finite state machine (FSM)-based test derivation methods against their coverage of code faults. In particular, we consider many realistic extended FSM examples and their related Java implementations and then derive for these examples complete test suites using the W method and its HSI and H derivatives in addition to singe transfer fault test suites. The W, HSI, and H test suites are derived considering the case when the implementation under test (IUT) has the same number of states as the specification FSM, and we also consider W++, HSI++, and H++ test suites derived when the IUT can have one state more than the specification machine. An assessment is then provided to determine for each pair of considered test suites if there is a difference between the pair in covering the implementations faults. If the difference is found significant, we determine which test suite outperforms the other. According to conducted experiments, the W method and its derivatives do not provide the same fault coverage of code faults; in contrast to their similar coverage of FSM-based faults. We further show that the results of this result are not due to size nor length of the test suites. In addition, as W tests outperformed both HSI and H tests, we further investigated whether these differences were due to certain types of faults or are spread over all classes of faults. Besides, another assessment is provided to determine whether certain test suites have better coverage of some classes/types of code faults than others. The empirical assessments use proper data transformation of mutation scores and p-value adjustments for controlling Type I error due to multiple tests. Results and outcomes of conducted experiments are summarized.College of EngineeringDepartment of Computer Science and EngineeringMaster of Science in Computer Engineering (MSCoE)El Fakih, Khaled2022-09-20T05:51:57Z2022-09-20T05:51:57Z2022-05info:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/doctoralThesisapplication/pdf35.232-2022.26http://hdl.handle.net/11073/24286en_USoai:repository.aus.edu:11073/242862025-06-26T12:27:22Z |
| spellingShingle | Empirical Evaluation of Extended Finite State Machine Test Suites Hasan, Faiz Mohammed Software engineering/software/program verification Software engineering/testing and debugging Software engineering/test design Extended finite state machines W, HSI, and H methods Mutation scores Test assessment Fault coverage |
| status_str | publishedVersion |
| title | Empirical Evaluation of Extended Finite State Machine Test Suites |
| title_full | Empirical Evaluation of Extended Finite State Machine Test Suites |
| title_fullStr | Empirical Evaluation of Extended Finite State Machine Test Suites |
| title_full_unstemmed | Empirical Evaluation of Extended Finite State Machine Test Suites |
| title_short | Empirical Evaluation of Extended Finite State Machine Test Suites |
| title_sort | Empirical Evaluation of Extended Finite State Machine Test Suites |
| topic | Software engineering/software/program verification Software engineering/testing and debugging Software engineering/test design Extended finite state machines W, HSI, and H methods Mutation scores Test assessment Fault coverage |
| url | http://hdl.handle.net/11073/24286 |