A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach
Artificial Intelligence (AI) is a technology that enables machines to mimic human intelligence, with core fields including Natural Language Processing (NLP) and Machine Learning (ML). Chatbot is a prominent AI application, that uses NLP techniques to engage in human-like conversations, enhancing hum...
Saved in:
| Main Author: | |
|---|---|
| Published: |
2023
|
| Subjects: | |
| Online Access: | https://bspace.buid.ac.ae/handle/1234/3359 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1862980620863406080 |
|---|---|
| author | ALAZZAM, BAYAN AHMAD |
| author_facet | ALAZZAM, BAYAN AHMAD |
| author_role | author |
| dc.contributor.none.fl_str_mv | Prof Shaalan Khaled |
| dc.creator.none.fl_str_mv | ALAZZAM, BAYAN AHMAD |
| dc.date.none.fl_str_mv | 2023-10 2025-12-05T11:15:51Z |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | 20197461 https://bspace.buid.ac.ae/handle/1234/3359 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | The British University in Dubai (BUiD) |
| dc.subject.none.fl_str_mv | chatbots artificial intelligence machine learning deep learning Arabic language neural network Emirati dialect natural language processing corpus |
| dc.title.none.fl_str_mv | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach |
| dc.type.none.fl_str_mv | Thesis |
| description | Artificial Intelligence (AI) is a technology that enables machines to mimic human intelligence, with core fields including Natural Language Processing (NLP) and Machine Learning (ML). Chatbot is a prominent AI application, that uses NLP techniques to engage in human-like conversations, enhancing human-machine interactions. This thesis explores the development of a chatbot that can automatically answer natural language questions, a key goal in AI. It provides a historical overview of chatbot evolution, generic workflow, and applications across various sectors. However, Chatbots are widely used, but there is a significant gap in systems specifically designed for the Gulf Emirati Arabic dialect, particularly in educational institutions and public sector universities, Existing systems are often trained on general corpora or other languages, highlighting a research gap in this area. Our proposed model addresses this gap by combining two advanced approaches in NLP. First, we employ Bidirectional Long Short-Term Memory (BiLSTM) networks for text generation, leveraging their ability to grasp contextual information and model long-term dependencies. Second, we integrate the Transformer model for both the encoding and decoding processes. This dual architecture enables our model to generate responses in Modern Standard Arabic (MSA) even when questions are posed in Gulf Arabic Dialect (GAD). The Transformer model was developed to handle MSA and GAD inputs in mixed-language environments. Three models were developed: BiLSTM, BiLSTM with Farasa Segmentation, and Hybrid BiLSTM-Transformer. After extensive experimentation, the Hybrid BiLSTM-Transformer model was the best-performing, achieving a BLEU score of 0.8674, 83% accuracy, and an F1 score of 0.86. |
| id | budr_eceb6a27837923ae86e8cab8982ede8e |
| identifier_str_mv | 20197461 |
| language_invalid_str_mv | en |
| network_acronym_str | budr |
| network_name_str | The British University in Dubai repository |
| oai_identifier_str | oai:bspace.buid.ac.ae:1234/3359 |
| publishDate | 2023 |
| publisher.none.fl_str_mv | The British University in Dubai (BUiD) |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer ApproachALAZZAM, BAYAN AHMADchatbotsartificial intelligencemachine learningdeep learningArabic languageneural networkEmirati dialectnatural language processingcorpusArtificial Intelligence (AI) is a technology that enables machines to mimic human intelligence, with core fields including Natural Language Processing (NLP) and Machine Learning (ML). Chatbot is a prominent AI application, that uses NLP techniques to engage in human-like conversations, enhancing human-machine interactions. This thesis explores the development of a chatbot that can automatically answer natural language questions, a key goal in AI. It provides a historical overview of chatbot evolution, generic workflow, and applications across various sectors. However, Chatbots are widely used, but there is a significant gap in systems specifically designed for the Gulf Emirati Arabic dialect, particularly in educational institutions and public sector universities, Existing systems are often trained on general corpora or other languages, highlighting a research gap in this area. Our proposed model addresses this gap by combining two advanced approaches in NLP. First, we employ Bidirectional Long Short-Term Memory (BiLSTM) networks for text generation, leveraging their ability to grasp contextual information and model long-term dependencies. Second, we integrate the Transformer model for both the encoding and decoding processes. This dual architecture enables our model to generate responses in Modern Standard Arabic (MSA) even when questions are posed in Gulf Arabic Dialect (GAD). The Transformer model was developed to handle MSA and GAD inputs in mixed-language environments. Three models were developed: BiLSTM, BiLSTM with Farasa Segmentation, and Hybrid BiLSTM-Transformer. After extensive experimentation, the Hybrid BiLSTM-Transformer model was the best-performing, achieving a BLEU score of 0.8674, 83% accuracy, and an F1 score of 0.86.The British University in Dubai (BUiD)Prof Shaalan Khaled2025-12-05T11:15:51Z2023-10Thesisapplication/pdf20197461https://bspace.buid.ac.ae/handle/1234/3359enoai:bspace.buid.ac.ae:1234/33592026-01-08T13:38:54Z |
| spellingShingle | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach ALAZZAM, BAYAN AHMAD chatbots artificial intelligence machine learning deep learning Arabic language neural network Emirati dialect natural language processing corpus |
| title | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach |
| title_full | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach |
| title_fullStr | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach |
| title_full_unstemmed | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach |
| title_short | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach |
| title_sort | A Deep Neural Network Chatbot for the Gulf Arabic Dialect: A Hybrid BiLSTM-Transformer Approach |
| topic | chatbots artificial intelligence machine learning deep learning Arabic language neural network Emirati dialect natural language processing corpus |
| url | https://bspace.buid.ac.ae/handle/1234/3359 |