Studying cooperative multi-agent reinforcement learning in networks
DISSERTATION WITH DISTINCTION
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| منشور في: |
2012
|
| الموضوعات: | |
| الوصول للمادة أونلاين: | http://bspace.buid.ac.ae/handle/1234/529 |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1862980618006036480 |
|---|---|
| author | Oudah, Mayada Mohamed |
| author_facet | Oudah, Mayada Mohamed |
| author_role | author |
| dc.creator.none.fl_str_mv | Oudah, Mayada Mohamed |
| dc.date.none.fl_str_mv | 2012-05 2014-02-10T08:44:58Z 2014-02-10T08:44:58Z |
| dc.format.none.fl_str_mv | application/pdf |
| dc.identifier.none.fl_str_mv | 100036 http://bspace.buid.ac.ae/handle/1234/529 |
| dc.language.none.fl_str_mv | en |
| dc.publisher.none.fl_str_mv | The British University in Dubai (BUiD) |
| dc.subject.none.fl_str_mv | multi-agent reinforcement Q-learning |
| dc.title.none.fl_str_mv | Studying cooperative multi-agent reinforcement learning in networks |
| dc.type.none.fl_str_mv | Dissertation |
| description | DISSERTATION WITH DISTINCTION |
| id | budr_acdfeafe51ec01d1b11bf04892120a10 |
| identifier_str_mv | 100036 |
| language_invalid_str_mv | en |
| network_acronym_str | budr |
| network_name_str | The British University in Dubai repository |
| oai_identifier_str | oai:bspace.buid.ac.ae:1234/529 |
| publishDate | 2012 |
| publisher.none.fl_str_mv | The British University in Dubai (BUiD) |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| spelling | Studying cooperative multi-agent reinforcement learning in networksOudah, Mayada Mohamedmulti-agent reinforcementQ-learningDISSERTATION WITH DISTINCTIONCooperative Multi-Agent systems, where agents work together as one team to achieve a common goal, form the majority of real-life multi-agent applications. Therefore, it is important to find a suitable multi-agent reinforcement learning algorithm to help agents to achieve their goal through finding the optimal joint policy that maximizes the team’s total reward. Since the last decade, several multi-agent learning algorithms have been proposed and applied to cooperative multi-agent settings. However, most of these learning algorithms do not allow agents to communicate with each other during the execution time, making it hard for agents to coordinate their actions especially in large-scale and partially observable domains. Thus, several coordinated learning algorithms which allow agents to communicate during the execution time have been applied to large cooperative multi-agent domains and proved to be efficient and effective in such domains. Nonetheless, to the best of our knowledge, there is no work that studied the characteristics of such learning algorithms under different network structures. The work done in this thesis aims to study and analyze the characteristics of one of the recent coordinated multi-agent learning approaches, the coordinated Q-learning algorithm, in two-player two-action cooperative and semi-cooperative games under random and scale-free network structures. Also, this thesis conducts a comparison between the original Q-learning algorithm and the coordinated Q-learning algorithm to better understand the difference between both of these algorithms. A simulator has been built in order to conduct experimental analyses. Experimental results verify the robustness, effectiveness and efficiency of the coordinated Q-learning algorithm. The coordinated Q-learning algorithm converges faster and performs better than the original Q-learning algorithm due to its distributive nature and its communication feature which do not exist in the original Q-learning algorithm. Also, the performance of the coordinated Q-learning is not affected by the network structures of random and scale-free networks. Such characteristics can be utilized in future works to further improve the performance of different coordinated learning algorithms in different cooperative multi-agent domains.The British University in Dubai (BUiD)2014-02-10T08:44:58Z2014-02-10T08:44:58Z2012-05Dissertationapplication/pdf100036http://bspace.buid.ac.ae/handle/1234/529enoai:bspace.buid.ac.ae:1234/5292021-10-17T13:35:25Z |
| spellingShingle | Studying cooperative multi-agent reinforcement learning in networks Oudah, Mayada Mohamed multi-agent reinforcement Q-learning |
| title | Studying cooperative multi-agent reinforcement learning in networks |
| title_full | Studying cooperative multi-agent reinforcement learning in networks |
| title_fullStr | Studying cooperative multi-agent reinforcement learning in networks |
| title_full_unstemmed | Studying cooperative multi-agent reinforcement learning in networks |
| title_short | Studying cooperative multi-agent reinforcement learning in networks |
| title_sort | Studying cooperative multi-agent reinforcement learning in networks |
| topic | multi-agent reinforcement Q-learning |
| url | http://bspace.buid.ac.ae/handle/1234/529 |