An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control
<p dir="ltr">In the 34 developed and 156 developing countries, there are ~132 million disabled people who need a wheelchair, constituting 1.86% of the world population. Moreover, there are millions of people suffering from diseases related to motor disabilities, which cause inability...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , , , , , |
| Published: |
2020
|
| Subjects: | |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1864513511766360064 |
|---|---|
| author | Mahmoud Dahmani (18810247) |
| author2 | Muhammad E. H. Chowdhury (14150526) Amith Khandakar (14151981) Tawsifur Rahman (14150523) Khaled Al-Jayyousi (18810250) Abdalla Hefny (18810253) Serkan Kiranyaz (3762058) |
| author2_role | author author author author author author |
| author_facet | Mahmoud Dahmani (18810247) Muhammad E. H. Chowdhury (14150526) Amith Khandakar (14151981) Tawsifur Rahman (14150523) Khaled Al-Jayyousi (18810250) Abdalla Hefny (18810253) Serkan Kiranyaz (3762058) |
| author_role | author |
| dc.creator.none.fl_str_mv | Mahmoud Dahmani (18810247) Muhammad E. H. Chowdhury (14150526) Amith Khandakar (14151981) Tawsifur Rahman (14150523) Khaled Al-Jayyousi (18810250) Abdalla Hefny (18810253) Serkan Kiranyaz (3762058) |
| dc.date.none.fl_str_mv | 2020-07-15T06:00:00Z |
| dc.identifier.none.fl_str_mv | 10.3390/s20143936 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/An_Intelligent_and_Low-Cost_Eye-Tracking_System_for_Motorized_Wheelchair_Control/26020879 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Engineering Biomedical engineering Electrical engineering Information and computing sciences Computer vision and multimedia computation Machine learning convolutional neural networks (CNNs) machine learning eye tracking motorized wheelchair ultrasonic proximity sensors |
| dc.title.none.fl_str_mv | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p dir="ltr">In the 34 developed and 156 developing countries, there are ~132 million disabled people who need a wheelchair, constituting 1.86% of the world population. Moreover, there are millions of people suffering from diseases related to motor disabilities, which cause inability to produce controlled movement in any of the limbs or even head. This paper proposes a system to aid people with motor disabilities by restoring their ability to move effectively and effortlessly without having to rely on others utilizing an eye-controlled electric wheelchair. The system input is images of the user’s eye that are processed to estimate the gaze direction and the wheelchair was moved accordingly. To accomplish such a feat, four user-specific methods were developed, implemented, and tested; all of which were based on a benchmark database created by the authors. The first three techniques were automatic, employ correlation, and were variants of template matching, whereas the last one uses convolutional neural networks (CNNs). Different metrics to quantitatively evaluate the performance of each algorithm in terms of accuracy and latency were computed and overall comparison is presented. CNN exhibited the best performance (i.e., 99.3% classification accuracy), and thus it was the model of choice for the gaze estimator, which commands the wheelchair motion. The system was evaluated carefully on eight subjects achieving 99% accuracy in changing illumination conditions outdoor and indoor. This required modifying a motorized wheelchair to adapt it to the predictions output by the gaze estimation algorithm. The wheelchair control can bypass any decision made by the gaze estimator and immediately halt its motion with the help of an array of proximity sensors, if the measured distance goes below a well-defined safety margin. This work not only empowers any immobile wheelchair user, but also provides low-cost tools for the organization assisting wheelchair users.</p><h2>Other Information</h2><p dir="ltr">Published in: Sensors<br>License: <a href="https://creativecommons.org/licenses/by/4.0/" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.3390/s20143936" target="_blank">https://dx.doi.org/10.3390/s20143936</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_606198b2db64fb620e68d8a14e0624cb |
| identifier_str_mv | 10.3390/s20143936 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/26020879 |
| publishDate | 2020 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair ControlMahmoud Dahmani (18810247)Muhammad E. H. Chowdhury (14150526)Amith Khandakar (14151981)Tawsifur Rahman (14150523)Khaled Al-Jayyousi (18810250)Abdalla Hefny (18810253)Serkan Kiranyaz (3762058)EngineeringBiomedical engineeringElectrical engineeringInformation and computing sciencesComputer vision and multimedia computationMachine learningconvolutional neural networks (CNNs)machine learningeye trackingmotorized wheelchairultrasonic proximity sensors<p dir="ltr">In the 34 developed and 156 developing countries, there are ~132 million disabled people who need a wheelchair, constituting 1.86% of the world population. Moreover, there are millions of people suffering from diseases related to motor disabilities, which cause inability to produce controlled movement in any of the limbs or even head. This paper proposes a system to aid people with motor disabilities by restoring their ability to move effectively and effortlessly without having to rely on others utilizing an eye-controlled electric wheelchair. The system input is images of the user’s eye that are processed to estimate the gaze direction and the wheelchair was moved accordingly. To accomplish such a feat, four user-specific methods were developed, implemented, and tested; all of which were based on a benchmark database created by the authors. The first three techniques were automatic, employ correlation, and were variants of template matching, whereas the last one uses convolutional neural networks (CNNs). Different metrics to quantitatively evaluate the performance of each algorithm in terms of accuracy and latency were computed and overall comparison is presented. CNN exhibited the best performance (i.e., 99.3% classification accuracy), and thus it was the model of choice for the gaze estimator, which commands the wheelchair motion. The system was evaluated carefully on eight subjects achieving 99% accuracy in changing illumination conditions outdoor and indoor. This required modifying a motorized wheelchair to adapt it to the predictions output by the gaze estimation algorithm. The wheelchair control can bypass any decision made by the gaze estimator and immediately halt its motion with the help of an array of proximity sensors, if the measured distance goes below a well-defined safety margin. This work not only empowers any immobile wheelchair user, but also provides low-cost tools for the organization assisting wheelchair users.</p><h2>Other Information</h2><p dir="ltr">Published in: Sensors<br>License: <a href="https://creativecommons.org/licenses/by/4.0/" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.3390/s20143936" target="_blank">https://dx.doi.org/10.3390/s20143936</a></p>2020-07-15T06:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.3390/s20143936https://figshare.com/articles/journal_contribution/An_Intelligent_and_Low-Cost_Eye-Tracking_System_for_Motorized_Wheelchair_Control/26020879CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/260208792020-07-15T06:00:00Z |
| spellingShingle | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control Mahmoud Dahmani (18810247) Engineering Biomedical engineering Electrical engineering Information and computing sciences Computer vision and multimedia computation Machine learning convolutional neural networks (CNNs) machine learning eye tracking motorized wheelchair ultrasonic proximity sensors |
| status_str | publishedVersion |
| title | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control |
| title_full | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control |
| title_fullStr | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control |
| title_full_unstemmed | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control |
| title_short | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control |
| title_sort | An Intelligent and Low-Cost Eye-Tracking System for Motorized Wheelchair Control |
| topic | Engineering Biomedical engineering Electrical engineering Information and computing sciences Computer vision and multimedia computation Machine learning convolutional neural networks (CNNs) machine learning eye tracking motorized wheelchair ultrasonic proximity sensors |