Arabic Sign Language Recognition: A Deep Learning Approach
With more than 300 sign languages across the world, sign interprets are not always available to translate spoken words into sign language and vice versa. As people with hearing and speech impairments rely on Sign Language for communication, this would limit their communication with others. A solutio...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| منشور في: |
2022
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | https://bspace.buid.ac.ae/handle/1234/2043 |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1862980620618039296 |
|---|---|
| author | ALMAHRI, HAMDA GHALIB AWADH ALI |
| author_facet | ALMAHRI, HAMDA GHALIB AWADH ALI |
| author_role | author |
| dc.creator.none.fl_str_mv | ALMAHRI, HAMDA GHALIB AWADH ALI |
| dc.date.none.fl_str_mv | 2022-07-26T05:50:49Z 2022-07-26T05:50:49Z 2022-05 |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | 20199870 https://bspace.buid.ac.ae/handle/1234/2043 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | The British University in Dubai (BUiD) |
| dc.subject.none.fl_str_mv | deep learning Arabic sign language recognition MediaPipe Emirati sign language United Arab Emirates (UAE) |
| dc.title.none.fl_str_mv | Arabic Sign Language Recognition: A Deep Learning Approach |
| dc.type.none.fl_str_mv | Dissertation |
| description | With more than 300 sign languages across the world, sign interprets are not always available to translate spoken words into sign language and vice versa. As people with hearing and speech impairments rely on Sign Language for communication, this would limit their communication with others. A solution for this would be utilizing Sign Language Recognition systems, which allow for communication between users of the sign language and those who do not without the need for interpreters. As we consider the success of Deep Learning for Computer Vision tasks, we observe the advantage it can provide for Arabic Sign Language Recognition. For this research, we have two aims. First, we would like to review the current status of research in Arabic Sign Language Recognition using Deep Learning and find research gaps. Second, we aim to build a Sign Language Recognition system that bridges the gap. We achieve this through a systematic review that identifies primary studies using deep learning models for Arabic Sign Language Recognition. Out of 414 identified studies, 67 were deemed of relevance to our topic. Out of those, 32 studies passed our full selection procedure. We were able to discover patterns in research and find that the biggest issue is data collection as current datasets don’t offer enough variety and are not representative of real-life scenarios. Current methods are either too expensive, or easily affected by the surrounding environment. Thus, for the second part, we offer a solution for data collection using MediaPipe, which allow us to collect data directly through the webcam. We are able to leverage this framework to build a recognition system for Emirati Sign Language that recognizes the signs for the seven Emirates. We used an LSTM model and achieve an accuracy of 100% in the testing dataset. |
| id | budr_8eac1ff3e4ce562823d61e0e9a7ada94 |
| identifier_str_mv | 20199870 |
| language_invalid_str_mv | en |
| network_acronym_str | budr |
| network_name_str | The British University in Dubai repository |
| oai_identifier_str | oai:bspace.buid.ac.ae:1234/2043 |
| publishDate | 2022 |
| publisher.none.fl_str_mv | The British University in Dubai (BUiD) |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | Arabic Sign Language Recognition: A Deep Learning ApproachALMAHRI, HAMDA GHALIB AWADH ALIdeep learningArabic sign language recognitionMediaPipeEmirati sign languageUnited Arab Emirates (UAE)With more than 300 sign languages across the world, sign interprets are not always available to translate spoken words into sign language and vice versa. As people with hearing and speech impairments rely on Sign Language for communication, this would limit their communication with others. A solution for this would be utilizing Sign Language Recognition systems, which allow for communication between users of the sign language and those who do not without the need for interpreters. As we consider the success of Deep Learning for Computer Vision tasks, we observe the advantage it can provide for Arabic Sign Language Recognition. For this research, we have two aims. First, we would like to review the current status of research in Arabic Sign Language Recognition using Deep Learning and find research gaps. Second, we aim to build a Sign Language Recognition system that bridges the gap. We achieve this through a systematic review that identifies primary studies using deep learning models for Arabic Sign Language Recognition. Out of 414 identified studies, 67 were deemed of relevance to our topic. Out of those, 32 studies passed our full selection procedure. We were able to discover patterns in research and find that the biggest issue is data collection as current datasets don’t offer enough variety and are not representative of real-life scenarios. Current methods are either too expensive, or easily affected by the surrounding environment. Thus, for the second part, we offer a solution for data collection using MediaPipe, which allow us to collect data directly through the webcam. We are able to leverage this framework to build a recognition system for Emirati Sign Language that recognizes the signs for the seven Emirates. We used an LSTM model and achieve an accuracy of 100% in the testing dataset.The British University in Dubai (BUiD)2022-07-26T05:50:49Z2022-07-26T05:50:49Z2022-05Dissertationapplication/pdf20199870https://bspace.buid.ac.ae/handle/1234/2043enoai:bspace.buid.ac.ae:1234/20432022-09-20T05:29:26Z |
| spellingShingle | Arabic Sign Language Recognition: A Deep Learning Approach ALMAHRI, HAMDA GHALIB AWADH ALI deep learning Arabic sign language recognition MediaPipe Emirati sign language United Arab Emirates (UAE) |
| title | Arabic Sign Language Recognition: A Deep Learning Approach |
| title_full | Arabic Sign Language Recognition: A Deep Learning Approach |
| title_fullStr | Arabic Sign Language Recognition: A Deep Learning Approach |
| title_full_unstemmed | Arabic Sign Language Recognition: A Deep Learning Approach |
| title_short | Arabic Sign Language Recognition: A Deep Learning Approach |
| title_sort | Arabic Sign Language Recognition: A Deep Learning Approach |
| topic | deep learning Arabic sign language recognition MediaPipe Emirati sign language United Arab Emirates (UAE) |
| url | https://bspace.buid.ac.ae/handle/1234/2043 |