AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI
Interviewing skills play a pivotal role in the job application and search, professional development to prepare for interviewing is a neglected area of research. Professional training methods are available but are often prohibitively expensive, limiting opportunities primarily to privileged individua...
Saved in:
| Main Author: | |
|---|---|
| Other Authors: | , , , , , , |
| Format: | article |
| Published: |
2025
|
| Subjects: | |
| Online Access: | http://dx.doi.org/10.1016/j.caeai.2024.100347 https://www.sciencedirect.com/science/article/pii/S2666920X24001504 http://hdl.handle.net/10576/65984 |
| Tags: |
Add Tag
No Tags, Be the first to tag this record!
|
| _version_ | 1857415083713363968 |
|---|---|
| author | Abdullah Bin, Nofal |
| author2 | Ali, Hassan Hadi, Muhammad Ahmad, Aizaz Qayyum, Adnan Johri, Aditya Al-Fuqaha, Ala Qadir, Junaid |
| author2_role | author author author author author author author |
| author_facet | Abdullah Bin, Nofal Ali, Hassan Hadi, Muhammad Ahmad, Aizaz Qayyum, Adnan Johri, Aditya Al-Fuqaha, Ala Qadir, Junaid |
| author_role | author |
| dc.creator.none.fl_str_mv | Abdullah Bin, Nofal Ali, Hassan Hadi, Muhammad Ahmad, Aizaz Qayyum, Adnan Johri, Aditya Al-Fuqaha, Ala Qadir, Junaid |
| dc.date.none.fl_str_mv | 2025-07-07T04:13:04Z 2025-06-30 |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | http://dx.doi.org/10.1016/j.caeai.2024.100347 Nofal, A. B., Ali, H., Hadi, M., Ahmad, A., Qayyum, A., Johri, A., ... & Qadir, J. (2025). AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI. Computers and Education: Artificial Intelligence, 8, 100347. 2666920X https://www.sciencedirect.com/science/article/pii/S2666920X24001504 http://hdl.handle.net/10576/65984 8 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | Elsevier |
| dc.rights.none.fl_str_mv | http://creativecommons.org/licenses/by/4.0/ info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Metaverse Generative AI Large language models Interview simulation Education Training |
| dc.title.none.fl_str_mv | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI |
| dc.type.none.fl_str_mv | Article info:eu-repo/semantics/publishedVersion info:eu-repo/semantics/article |
| description | Interviewing skills play a pivotal role in the job application and search, professional development to prepare for interviewing is a neglected area of research. Professional training methods are available but are often prohibitively expensive, limiting opportunities primarily to privileged individuals. To bridge this accessibility gap and democratize access to job opportunities, there is a need to develop automated interview simulation platforms. The advent of Generative AI (GenAI) technology, in particular Large Language Models (LLMs), makes this is viable proposition but progress is hindered by the absence of open-source implementations for reproducibility and comparison, as well as the lack of suitable evaluation benchmarks and experimental setups. In particular, we do not yet know how robust such systems are and if they will be bias-free, factors that will contribute to their acceptability and use. To this end, we propose Interview Training and Education Module (ITEM), a job interview training module that combines Virtual Reality-based metaverse technology with LLM-based GenAI models. Our module creates realistic interview experiences for skill enhancement, complete with personalized feedback and improvement guidelines based on user responses. In this paper, we present an experimental evaluation of the module to ascertain its robustness, including a bias analysis. Firstly, we establish an experimental setup to gauge platform robustness by examining question similarity across varied prompts using Bidirectional and Auto-Regressive Transformers (BART) and topic modeling. Subsequently, we explore biases in three categories—country of origin, religion, and gender—by analyzing ITEM's evaluation scores while manipulating candidate backgrounds, all while keeping their responses unchanged. Our findings indicate potential biases replicated by ITEM, highlighting the need for caution in its application for personal development and training. This pioneering initiative introduces the first open-source module for job interview training within a virtual metaverse, leveraging LLM-based Generative AI, designed for extension and testing by the scientific community, thereby enhancing insights into the limitations and ethical considerations of AI-driven interview simulation platforms. |
| eu_rights_str_mv | openAccess |
| format | article |
| id | qu_c5ae0b722343914d8347db8486f064ee |
| identifier_str_mv | Nofal, A. B., Ali, H., Hadi, M., Ahmad, A., Qayyum, A., Johri, A., ... & Qadir, J. (2025). AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI. Computers and Education: Artificial Intelligence, 8, 100347. 2666920X 8 |
| language_invalid_str_mv | en |
| network_acronym_str | qu |
| network_name_str | Qatar University repository |
| oai_identifier_str | oai:qspace.qu.edu.qa:10576/65984 |
| publishDate | 2025 |
| publisher.none.fl_str_mv | Elsevier |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | http://creativecommons.org/licenses/by/4.0/ |
| spelling | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AIAbdullah Bin, NofalAli, HassanHadi, MuhammadAhmad, AizazQayyum, AdnanJohri, AdityaAl-Fuqaha, AlaQadir, JunaidMetaverseGenerative AILarge language modelsInterview simulationEducationTrainingInterviewing skills play a pivotal role in the job application and search, professional development to prepare for interviewing is a neglected area of research. Professional training methods are available but are often prohibitively expensive, limiting opportunities primarily to privileged individuals. To bridge this accessibility gap and democratize access to job opportunities, there is a need to develop automated interview simulation platforms. The advent of Generative AI (GenAI) technology, in particular Large Language Models (LLMs), makes this is viable proposition but progress is hindered by the absence of open-source implementations for reproducibility and comparison, as well as the lack of suitable evaluation benchmarks and experimental setups. In particular, we do not yet know how robust such systems are and if they will be bias-free, factors that will contribute to their acceptability and use. To this end, we propose Interview Training and Education Module (ITEM), a job interview training module that combines Virtual Reality-based metaverse technology with LLM-based GenAI models. Our module creates realistic interview experiences for skill enhancement, complete with personalized feedback and improvement guidelines based on user responses. In this paper, we present an experimental evaluation of the module to ascertain its robustness, including a bias analysis. Firstly, we establish an experimental setup to gauge platform robustness by examining question similarity across varied prompts using Bidirectional and Auto-Regressive Transformers (BART) and topic modeling. Subsequently, we explore biases in three categories—country of origin, religion, and gender—by analyzing ITEM's evaluation scores while manipulating candidate backgrounds, all while keeping their responses unchanged. Our findings indicate potential biases replicated by ITEM, highlighting the need for caution in its application for personal development and training. This pioneering initiative introduces the first open-source module for job interview training within a virtual metaverse, leveraging LLM-based Generative AI, designed for extension and testing by the scientific community, thereby enhancing insights into the limitations and ethical considerations of AI-driven interview simulation platforms.The authors would like to acknowledge support from Qatar University High Impact Internal Grant (QUHI-CENG23/24-127). Open access funding is provided by Qatar National Library. The statements made herein are solely the responsibility of the authors. We are also thankful to the IEEE ITU Society for helping us in conducting the interview of students.Elsevier2025-07-07T04:13:04Z2025-06-30Articleinfo:eu-repo/semantics/publishedVersioninfo:eu-repo/semantics/articleapplication/pdfhttp://dx.doi.org/10.1016/j.caeai.2024.100347Nofal, A. B., Ali, H., Hadi, M., Ahmad, A., Qayyum, A., Johri, A., ... & Qadir, J. (2025). AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI. Computers and Education: Artificial Intelligence, 8, 100347.2666920Xhttps://www.sciencedirect.com/science/article/pii/S2666920X24001504http://hdl.handle.net/10576/659848enhttp://creativecommons.org/licenses/by/4.0/info:eu-repo/semantics/openAccessoai:qspace.qu.edu.qa:10576/659842025-07-07T19:06:17Z |
| spellingShingle | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI Abdullah Bin, Nofal Metaverse Generative AI Large language models Interview simulation Education Training |
| status_str | publishedVersion |
| title | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI |
| title_full | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI |
| title_fullStr | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI |
| title_full_unstemmed | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI |
| title_short | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI |
| title_sort | AI-enhanced interview simulation in the metaverse: Transforming professional skills training through VR and generative conversational AI |
| topic | Metaverse Generative AI Large language models Interview simulation Education Training |
| url | http://dx.doi.org/10.1016/j.caeai.2024.100347 https://www.sciencedirect.com/science/article/pii/S2666920X24001504 http://hdl.handle.net/10576/65984 |