LimitAccess: on-device TinyML based robust speech recognition and age classification
<p dir="ltr">Automakers from Honda to Lamborghini are incorporating voice interaction technology into their vehicles to improve the user experience and offer value-added services. Speech recognition systems are a key component of smart cars, enhancing convenience and safety for drive...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , , , |
| منشور في: |
2023
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513530438352896 |
|---|---|
| author | Marina Maayah (17707242) |
| author2 | Ahlam Abunada (17807372) Khawla Al-Janahi (17807375) Muhammad Ejaz Ahmed (17807378) Junaid Qadir (16494902) |
| author2_role | author author author author |
| author_facet | Marina Maayah (17707242) Ahlam Abunada (17807372) Khawla Al-Janahi (17807375) Muhammad Ejaz Ahmed (17807378) Junaid Qadir (16494902) |
| author_role | author |
| dc.creator.none.fl_str_mv | Marina Maayah (17707242) Ahlam Abunada (17807372) Khawla Al-Janahi (17807375) Muhammad Ejaz Ahmed (17807378) Junaid Qadir (16494902) |
| dc.date.none.fl_str_mv | 2023-02-20T03:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1007/s44163-023-00051-x |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/LimitAccess_on-device_TinyML_based_robust_speech_recognition_and_age_classification/25018010 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Engineering Automotive engineering Information and computing sciences Artificial intelligence Machine learning Age classifcation Speech recognition Embedded devices Tiny machine learning Embedded machine learning Edge artifcial intelligence |
| dc.title.none.fl_str_mv | LimitAccess: on-device TinyML based robust speech recognition and age classification |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p dir="ltr">Automakers from Honda to Lamborghini are incorporating voice interaction technology into their vehicles to improve the user experience and offer value-added services. Speech recognition systems are a key component of smart cars, enhancing convenience and safety for drivers and passengers. In the future, safety-critical features may rely on speech recognition, but this raises concerns about children accessing such services. To address this issue, the LimitAccess system is proposed, which uses TinyML for age classification and helps parents limit children’s access to critical speech recognition services. This study employs a lite convolutional neural network (CNN) model for two different reasons: First, CNN showed superior accuracy compared to other audio classification models for age classification problems. Second, the lite model will be integrated into a microcontroller to meet its limited resource requirements. To train and evaluate our model, we created a dataset that included child and adult voices of the keyword “open”. The system approach categorizes voices into age groups (child, adult) and then utilizes that categorization to grant access to a car. The robustness of the model was enhanced by adding a new class (recordings) to the dataset, which enabled our system to detect replay and synthetic voice attacks. If an adult voice is detected, access to start the car will be granted. However, if a child’s voice or a recording is detected, the system will display a warning message that educates the child about the dangers and consequences of the improper use of a car. Arduino Nano 33 BLE sensing was our embedded device of choice for integrating our trained, optimized model. Our system achieved an overall F1 score of 87.7% and 85.89% accuracy. LimitAccess detected replay and synthetic voice attacks with an 88% F1 score.</p><h2>Other Information</h2><p dir="ltr">Published in: Discover Artificial Intelligence<br>License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s44163-023-00051-x" target="_blank">https://dx.doi.org/10.1007/s44163-023-00051-x</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_2847f03f32dbcca716c031fa8b6d1120 |
| identifier_str_mv | 10.1007/s44163-023-00051-x |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/25018010 |
| publishDate | 2023 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | LimitAccess: on-device TinyML based robust speech recognition and age classificationMarina Maayah (17707242)Ahlam Abunada (17807372)Khawla Al-Janahi (17807375)Muhammad Ejaz Ahmed (17807378)Junaid Qadir (16494902)EngineeringAutomotive engineeringInformation and computing sciencesArtificial intelligenceMachine learningAge classifcationSpeech recognitionEmbedded devicesTiny machine learningEmbedded machine learningEdge artifcial intelligence<p dir="ltr">Automakers from Honda to Lamborghini are incorporating voice interaction technology into their vehicles to improve the user experience and offer value-added services. Speech recognition systems are a key component of smart cars, enhancing convenience and safety for drivers and passengers. In the future, safety-critical features may rely on speech recognition, but this raises concerns about children accessing such services. To address this issue, the LimitAccess system is proposed, which uses TinyML for age classification and helps parents limit children’s access to critical speech recognition services. This study employs a lite convolutional neural network (CNN) model for two different reasons: First, CNN showed superior accuracy compared to other audio classification models for age classification problems. Second, the lite model will be integrated into a microcontroller to meet its limited resource requirements. To train and evaluate our model, we created a dataset that included child and adult voices of the keyword “open”. The system approach categorizes voices into age groups (child, adult) and then utilizes that categorization to grant access to a car. The robustness of the model was enhanced by adding a new class (recordings) to the dataset, which enabled our system to detect replay and synthetic voice attacks. If an adult voice is detected, access to start the car will be granted. However, if a child’s voice or a recording is detected, the system will display a warning message that educates the child about the dangers and consequences of the improper use of a car. Arduino Nano 33 BLE sensing was our embedded device of choice for integrating our trained, optimized model. Our system achieved an overall F1 score of 87.7% and 85.89% accuracy. LimitAccess detected replay and synthetic voice attacks with an 88% F1 score.</p><h2>Other Information</h2><p dir="ltr">Published in: Discover Artificial Intelligence<br>License: <a href="https://creativecommons.org/licenses/by/4.0" target="_blank">https://creativecommons.org/licenses/by/4.0</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1007/s44163-023-00051-x" target="_blank">https://dx.doi.org/10.1007/s44163-023-00051-x</a></p>2023-02-20T03:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1007/s44163-023-00051-xhttps://figshare.com/articles/journal_contribution/LimitAccess_on-device_TinyML_based_robust_speech_recognition_and_age_classification/25018010CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/250180102023-02-20T03:00:00Z |
| spellingShingle | LimitAccess: on-device TinyML based robust speech recognition and age classification Marina Maayah (17707242) Engineering Automotive engineering Information and computing sciences Artificial intelligence Machine learning Age classifcation Speech recognition Embedded devices Tiny machine learning Embedded machine learning Edge artifcial intelligence |
| status_str | publishedVersion |
| title | LimitAccess: on-device TinyML based robust speech recognition and age classification |
| title_full | LimitAccess: on-device TinyML based robust speech recognition and age classification |
| title_fullStr | LimitAccess: on-device TinyML based robust speech recognition and age classification |
| title_full_unstemmed | LimitAccess: on-device TinyML based robust speech recognition and age classification |
| title_short | LimitAccess: on-device TinyML based robust speech recognition and age classification |
| title_sort | LimitAccess: on-device TinyML based robust speech recognition and age classification |
| topic | Engineering Automotive engineering Information and computing sciences Artificial intelligence Machine learning Age classifcation Speech recognition Embedded devices Tiny machine learning Embedded machine learning Edge artifcial intelligence |