Assessing test suites of extended finite state machines against model and code based faults
Tests can be derived from extended finite state machine (EFSM) specifications considering the coverage of single-transfer faults, all transitions using a transition tour, all-uses, edge-pair, and prime path with side trip. We provide novel empirical assessments of the effectiveness of these test sui...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , |
| Format: | article |
| Published: |
2021
|
| Subjects: | |
| Online Access: | http://hdl.handle.net/11073/25061 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1864513431892131840 |
|---|---|
| author | El-Fakih, Khaled |
| author2 | Alzaatreh, Ayman Turker, Uraz Cengiz |
| author2_role | author author |
| author_facet | El-Fakih, Khaled Alzaatreh, Ayman Turker, Uraz Cengiz |
| author_role | author |
| dc.creator.none.fl_str_mv | El-Fakih, Khaled Alzaatreh, Ayman Turker, Uraz Cengiz |
| dc.date.none.fl_str_mv | 2021 2022-11-01T05:31:41Z 2022-11-01T05:31:41Z |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | El-Fakih, K, Alzaatreh, A, Türker, UC. Assessing test suites of extended finite state machines against model- and code-based faults. Softw Test Verif Reliab. 2022; 32( 7):e1789. https://doi.org/10.1002/stvr.1789 1099-1689 http://hdl.handle.net/11073/25061 10.1002/stvr.1789 |
| dc.language.none.fl_str_mv | en_US |
| dc.publisher.none.fl_str_mv | John Wiley & Sons |
| dc.relation.none.fl_str_mv | https://doi.org/10.1002/stvr.1789 |
| dc.subject.none.fl_str_mv | Model-based testing Mutation testing Extended finite state machines Empirical assessment Mutation scores |
| dc.title.none.fl_str_mv | Assessing test suites of extended finite state machines against model and code based faults |
| dc.type.none.fl_str_mv | Peer-Reviewed Postprint info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/article |
| description | Tests can be derived from extended finite state machine (EFSM) specifications considering the coverage of single-transfer faults, all transitions using a transition tour, all-uses, edge-pair, and prime path with side trip. We provide novel empirical assessments of the effectiveness of these test suites. The first assessment determines for each pair of test suites if there is a difference between the pair in covering EFSM faults of six EFSM specifications. If the difference is found significant, we determine which test suite outperforms the other. The second assessment is similar to the first; yet, it is carried out against code faults of 12 Java implementations of the specifications. Besides, two assessments are provided to determine whether test suites have better coverage of certain classes of EFSM (or code) faults than others. The evaluation uses proper data transformation of mutation scores and p-value adjustments for controlling Type I error due to multiple tests. Furthermore, we show that subsuming mutants have an impact on mutation scores of both EFSM and code faults; and accordingly, we use a score that removes them in order not to invalidate the obtained results. The assessments show that all-uses tests were outperformed by all other tests; transition tours outperformed both edge-pair and prime path with side trips; and single-transfer fault tests outperformed all other test suites. Similar results are obtained over the considered EFSM and code fault domains, and there were no significant differences between the test suites coverage of different classes of EFSM and code faults. |
| format | article |
| id | aus_43d41b5f495d99c6b33b748f91d95daa |
| identifier_str_mv | El-Fakih, K, Alzaatreh, A, Türker, UC. Assessing test suites of extended finite state machines against model- and code-based faults. Softw Test Verif Reliab. 2022; 32( 7):e1789. https://doi.org/10.1002/stvr.1789 1099-1689 10.1002/stvr.1789 |
| language_invalid_str_mv | en_US |
| network_acronym_str | aus |
| network_name_str | aus |
| oai_identifier_str | oai:repository.aus.edu:11073/25061 |
| publishDate | 2021 |
| publisher.none.fl_str_mv | John Wiley & Sons |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | Assessing test suites of extended finite state machines against model and code based faultsEl-Fakih, KhaledAlzaatreh, AymanTurker, Uraz CengizModel-based testingMutation testingExtended finite state machinesEmpirical assessmentMutation scoresTests can be derived from extended finite state machine (EFSM) specifications considering the coverage of single-transfer faults, all transitions using a transition tour, all-uses, edge-pair, and prime path with side trip. We provide novel empirical assessments of the effectiveness of these test suites. The first assessment determines for each pair of test suites if there is a difference between the pair in covering EFSM faults of six EFSM specifications. If the difference is found significant, we determine which test suite outperforms the other. The second assessment is similar to the first; yet, it is carried out against code faults of 12 Java implementations of the specifications. Besides, two assessments are provided to determine whether test suites have better coverage of certain classes of EFSM (or code) faults than others. The evaluation uses proper data transformation of mutation scores and p-value adjustments for controlling Type I error due to multiple tests. Furthermore, we show that subsuming mutants have an impact on mutation scores of both EFSM and code faults; and accordingly, we use a score that removes them in order not to invalidate the obtained results. The assessments show that all-uses tests were outperformed by all other tests; transition tours outperformed both edge-pair and prime path with side trips; and single-transfer fault tests outperformed all other test suites. Similar results are obtained over the considered EFSM and code fault domains, and there were no significant differences between the test suites coverage of different classes of EFSM and code faults.American University of SharjahJohn Wiley & Sons2022-11-01T05:31:41Z2022-11-01T05:31:41Z2021Peer-ReviewedPostprintinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfEl-Fakih, K, Alzaatreh, A, Türker, UC. Assessing test suites of extended finite state machines against model- and code-based faults. Softw Test Verif Reliab. 2022; 32( 7):e1789. https://doi.org/10.1002/stvr.17891099-1689http://hdl.handle.net/11073/2506110.1002/stvr.1789en_UShttps://doi.org/10.1002/stvr.1789oai:repository.aus.edu:11073/250612024-08-22T12:07:07Z |
| spellingShingle | Assessing test suites of extended finite state machines against model and code based faults El-Fakih, Khaled Model-based testing Mutation testing Extended finite state machines Empirical assessment Mutation scores |
| status_str | publishedVersion |
| title | Assessing test suites of extended finite state machines against model and code based faults |
| title_full | Assessing test suites of extended finite state machines against model and code based faults |
| title_fullStr | Assessing test suites of extended finite state machines against model and code based faults |
| title_full_unstemmed | Assessing test suites of extended finite state machines against model and code based faults |
| title_short | Assessing test suites of extended finite state machines against model and code based faults |
| title_sort | Assessing test suites of extended finite state machines against model and code based faults |
| topic | Model-based testing Mutation testing Extended finite state machines Empirical assessment Mutation scores |
| url | http://hdl.handle.net/11073/25061 |