Reinforcement Learning Based EV Charging Management Systems–A Review
<p>To mitigate global warming and energy shortage, integration of renewable energy generation sources, energy storage systems, and plug-in electric vehicles (PEVs) have been introduced in recent years. The application of electric vehicles (EV) in the smart grid has shown a significant option t...
محفوظ في:
| المؤلف الرئيسي: | |
|---|---|
| مؤلفون آخرون: | , |
| منشور في: |
2021
|
| الموضوعات: | |
| الوسوم: |
إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
|
| _version_ | 1864513560403509248 |
|---|---|
| author | Heba M. Abdullah (16896384) |
| author2 | Adel Gastli (14151273) Lazhar Ben-Brahim (16855554) |
| author2_role | author author |
| author_facet | Heba M. Abdullah (16896384) Adel Gastli (14151273) Lazhar Ben-Brahim (16855554) |
| author_role | author |
| dc.creator.none.fl_str_mv | Heba M. Abdullah (16896384) Adel Gastli (14151273) Lazhar Ben-Brahim (16855554) |
| dc.date.none.fl_str_mv | 2021-03-08T00:00:00Z |
| dc.identifier.none.fl_str_mv | 10.1109/access.2021.3064354 |
| dc.relation.none.fl_str_mv | https://figshare.com/articles/journal_contribution/Reinforcement_Learning_Based_EV_Charging_Management_Systems_A_Review/24049269 |
| dc.rights.none.fl_str_mv | CC BY 4.0 info:eu-repo/semantics/openAccess |
| dc.subject.none.fl_str_mv | Engineering Automotive engineering Electrical engineering Information and computing sciences Artificial intelligence Machine learning Electric vehicle charging Uncertainty Batteries Reinforcement learning Vehicle-to-grid Load modeling Optimization Global warming Artificial intelligence Electric vehicles Machine learning Management Smart grids |
| dc.title.none.fl_str_mv | Reinforcement Learning Based EV Charging Management Systems–A Review |
| dc.type.none.fl_str_mv | Text Journal contribution info:eu-repo/semantics/publishedVersion text contribution to journal |
| description | <p>To mitigate global warming and energy shortage, integration of renewable energy generation sources, energy storage systems, and plug-in electric vehicles (PEVs) have been introduced in recent years. The application of electric vehicles (EV) in the smart grid has shown a significant option to reduce carbon emission. However, due to the limited battery capacity, managing the charging and discharging process of EV as a distributed power supply is a challenging task. Moreover, the unpredictable nature of renewable energy generation, uncertainties of plug-in electric vehicles associated parameters, energy prices, and the time-varying load create new challenges for the researchers and industries to maintain a stable operation of the power system. The EV battery charging management system plays a main role in coordinating the charging and discharging mechanism to efficiently realize a secure, efficient, and reliable power system. More recently, there has been an increasing interest in data-driven approaches in EV charging modeling. Consequently, researchers are looking to deploy model-free approaches for solving the EV charging management with uncertainties. Among many existing model-free approaches, Reinforcement Learning (RL) has been widely used for EV charging management. Unlike other machine learning approaches, the RL technique is based on maximizing the cumulative reward. This article reviews the existing literature related to the RL-based framework, objectives, and architecture for the charging coordination strategies of electric vehicles in the power systems. In addition, the review paper presents a detailed comparative analysis of the techniques used for achieving different charging coordination objectives while satisfying multiple constraints. This article also focuses on the application of RL in EV coordination for research and development of the cutting-edge optimized energy management system (EMS), which are applicable for EV charging.</p><h2>Other Information</h2><p>Published in: IEEE Access<br>License: <a href="https://creativecommons.org/licenses/by/4.0/legalcode" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1109/access.2021.3064354" target="_blank">https://dx.doi.org/10.1109/access.2021.3064354</a></p> |
| eu_rights_str_mv | openAccess |
| id | Manara2_61d9d8a0d4464ead5d32c87a7f97e30b |
| identifier_str_mv | 10.1109/access.2021.3064354 |
| network_acronym_str | Manara2 |
| network_name_str | Manara2 |
| oai_identifier_str | oai:figshare.com:article/24049269 |
| publishDate | 2021 |
| repository.mail.fl_str_mv | |
| repository.name.fl_str_mv | |
| repository_id_str | |
| rights_invalid_str_mv | CC BY 4.0 |
| spelling | Reinforcement Learning Based EV Charging Management Systems–A ReviewHeba M. Abdullah (16896384)Adel Gastli (14151273)Lazhar Ben-Brahim (16855554)EngineeringAutomotive engineeringElectrical engineeringInformation and computing sciencesArtificial intelligenceMachine learningElectric vehicle chargingUncertaintyBatteriesReinforcement learningVehicle-to-gridLoad modelingOptimizationGlobal warmingArtificial intelligenceElectric vehiclesMachine learningManagementSmart grids<p>To mitigate global warming and energy shortage, integration of renewable energy generation sources, energy storage systems, and plug-in electric vehicles (PEVs) have been introduced in recent years. The application of electric vehicles (EV) in the smart grid has shown a significant option to reduce carbon emission. However, due to the limited battery capacity, managing the charging and discharging process of EV as a distributed power supply is a challenging task. Moreover, the unpredictable nature of renewable energy generation, uncertainties of plug-in electric vehicles associated parameters, energy prices, and the time-varying load create new challenges for the researchers and industries to maintain a stable operation of the power system. The EV battery charging management system plays a main role in coordinating the charging and discharging mechanism to efficiently realize a secure, efficient, and reliable power system. More recently, there has been an increasing interest in data-driven approaches in EV charging modeling. Consequently, researchers are looking to deploy model-free approaches for solving the EV charging management with uncertainties. Among many existing model-free approaches, Reinforcement Learning (RL) has been widely used for EV charging management. Unlike other machine learning approaches, the RL technique is based on maximizing the cumulative reward. This article reviews the existing literature related to the RL-based framework, objectives, and architecture for the charging coordination strategies of electric vehicles in the power systems. In addition, the review paper presents a detailed comparative analysis of the techniques used for achieving different charging coordination objectives while satisfying multiple constraints. This article also focuses on the application of RL in EV coordination for research and development of the cutting-edge optimized energy management system (EMS), which are applicable for EV charging.</p><h2>Other Information</h2><p>Published in: IEEE Access<br>License: <a href="https://creativecommons.org/licenses/by/4.0/legalcode" target="_blank">https://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1109/access.2021.3064354" target="_blank">https://dx.doi.org/10.1109/access.2021.3064354</a></p>2021-03-08T00:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1109/access.2021.3064354https://figshare.com/articles/journal_contribution/Reinforcement_Learning_Based_EV_Charging_Management_Systems_A_Review/24049269CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/240492692021-03-08T00:00:00Z |
| spellingShingle | Reinforcement Learning Based EV Charging Management Systems–A Review Heba M. Abdullah (16896384) Engineering Automotive engineering Electrical engineering Information and computing sciences Artificial intelligence Machine learning Electric vehicle charging Uncertainty Batteries Reinforcement learning Vehicle-to-grid Load modeling Optimization Global warming Artificial intelligence Electric vehicles Machine learning Management Smart grids |
| status_str | publishedVersion |
| title | Reinforcement Learning Based EV Charging Management Systems–A Review |
| title_full | Reinforcement Learning Based EV Charging Management Systems–A Review |
| title_fullStr | Reinforcement Learning Based EV Charging Management Systems–A Review |
| title_full_unstemmed | Reinforcement Learning Based EV Charging Management Systems–A Review |
| title_short | Reinforcement Learning Based EV Charging Management Systems–A Review |
| title_sort | Reinforcement Learning Based EV Charging Management Systems–A Review |
| topic | Engineering Automotive engineering Electrical engineering Information and computing sciences Artificial intelligence Machine learning Electric vehicle charging Uncertainty Batteries Reinforcement learning Vehicle-to-grid Load modeling Optimization Global warming Artificial intelligence Electric vehicles Machine learning Management Smart grids |