Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation

<p>EVs are becoming more popular and widely used worldwide due to their environmentally friendliness as part of the world efforts to decrease the effects of climate change. Moreover, more users are buying EVs due to governmental incentives, development of charging technologies and cheaper main...

وصف كامل

محفوظ في:
التفاصيل البيبلوغرافية
المؤلف الرئيسي: Mostafa M. Shibl (17821382) (author)
مؤلفون آخرون: Loay S. Ismail (17821385) (author), Ahmed M. Massoud (16896417) (author)
منشور في: 2023
الموضوعات:
الوسوم: إضافة وسم
لا توجد وسوم, كن أول من يضع وسما على هذه التسجيلة!
_version_ 1864513529464225792
author Mostafa M. Shibl (17821382)
author2 Loay S. Ismail (17821385)
Ahmed M. Massoud (16896417)
author2_role author
author
author_facet Mostafa M. Shibl (17821382)
Loay S. Ismail (17821385)
Ahmed M. Massoud (16896417)
author_role author
dc.creator.none.fl_str_mv Mostafa M. Shibl (17821382)
Loay S. Ismail (17821385)
Ahmed M. Massoud (16896417)
dc.date.none.fl_str_mv 2023-11-01T00:00:00Z
dc.identifier.none.fl_str_mv 10.1016/j.egyr.2023.07.008
dc.relation.none.fl_str_mv https://figshare.com/articles/journal_contribution/Electric_vehicles_charging_management_using_deep_reinforcement_learning_considering_vehicle-to-grid_operation_and_battery_degradation/25036685
dc.rights.none.fl_str_mv CC BY 4.0
info:eu-repo/semantics/openAccess
dc.subject.none.fl_str_mv Engineering
Automotive engineering
Control engineering, mechatronics and robotics
Electrical engineering
Information and computing sciences
Machine learning
Distribution grid
Optimization
Deep reinforcement learning
Electric vehicles charging
Vehicle-to-grid
Power system management
dc.title.none.fl_str_mv Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
dc.type.none.fl_str_mv Text
Journal contribution
info:eu-repo/semantics/publishedVersion
text
contribution to journal
description <p>EVs are becoming more popular and widely used worldwide due to their environmentally friendliness as part of the world efforts to decrease the effects of climate change. Moreover, more users are buying EVs due to governmental incentives, development of charging technologies and cheaper maintenance costs. Thus, the increased electrical loads on the distribution grid caused by the charging of EVs can have negative impacts such as high voltage fluctuations, power losses and power overloads. Thus, a power system management solution is required to protect the distribution grid from the harmful effects of EVs charging through the regulation of the charging of EVs. In this paper, a deep RL-based EVs charging management solution is presented, while considering fast charging, conventional charging and V2G operation, in order to satisfy the requirements of the user and the utility. Deep RL is utilized to model the EV chargers and the EV users. The EV chargers are considered the RL environment and the EV users are considered the RL agent. Finally, the system was tested with a range of case studies using real-life EVs charging data, which proved the effectiveness and reliability of the system to protect the distribution grid and satisfy the EV user’s charging requirements.</p><h2>Other Information</h2> <p> Published in: Energy Reports<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.egyr.2023.07.008" target="_blank">https://dx.doi.org/10.1016/j.egyr.2023.07.008</a></p>
eu_rights_str_mv openAccess
id Manara2_fcb5f904f4f7a93ef8c1cd68ccbb9e0c
identifier_str_mv 10.1016/j.egyr.2023.07.008
network_acronym_str Manara2
network_name_str Manara2
oai_identifier_str oai:figshare.com:article/25036685
publishDate 2023
repository.mail.fl_str_mv
repository.name.fl_str_mv
repository_id_str
rights_invalid_str_mv CC BY 4.0
spelling Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradationMostafa M. Shibl (17821382)Loay S. Ismail (17821385)Ahmed M. Massoud (16896417)EngineeringAutomotive engineeringControl engineering, mechatronics and roboticsElectrical engineeringInformation and computing sciencesMachine learningDistribution gridOptimizationDeep reinforcement learningElectric vehicles chargingVehicle-to-gridPower system management<p>EVs are becoming more popular and widely used worldwide due to their environmentally friendliness as part of the world efforts to decrease the effects of climate change. Moreover, more users are buying EVs due to governmental incentives, development of charging technologies and cheaper maintenance costs. Thus, the increased electrical loads on the distribution grid caused by the charging of EVs can have negative impacts such as high voltage fluctuations, power losses and power overloads. Thus, a power system management solution is required to protect the distribution grid from the harmful effects of EVs charging through the regulation of the charging of EVs. In this paper, a deep RL-based EVs charging management solution is presented, while considering fast charging, conventional charging and V2G operation, in order to satisfy the requirements of the user and the utility. Deep RL is utilized to model the EV chargers and the EV users. The EV chargers are considered the RL environment and the EV users are considered the RL agent. Finally, the system was tested with a range of case studies using real-life EVs charging data, which proved the effectiveness and reliability of the system to protect the distribution grid and satisfy the EV user’s charging requirements.</p><h2>Other Information</h2> <p> Published in: Energy Reports<br> License: <a href="http://creativecommons.org/licenses/by/4.0/" target="_blank">http://creativecommons.org/licenses/by/4.0/</a><br>See article on publisher's website: <a href="https://dx.doi.org/10.1016/j.egyr.2023.07.008" target="_blank">https://dx.doi.org/10.1016/j.egyr.2023.07.008</a></p>2023-11-01T00:00:00ZTextJournal contributioninfo:eu-repo/semantics/publishedVersiontextcontribution to journal10.1016/j.egyr.2023.07.008https://figshare.com/articles/journal_contribution/Electric_vehicles_charging_management_using_deep_reinforcement_learning_considering_vehicle-to-grid_operation_and_battery_degradation/25036685CC BY 4.0info:eu-repo/semantics/openAccessoai:figshare.com:article/250366852023-11-01T00:00:00Z
spellingShingle Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
Mostafa M. Shibl (17821382)
Engineering
Automotive engineering
Control engineering, mechatronics and robotics
Electrical engineering
Information and computing sciences
Machine learning
Distribution grid
Optimization
Deep reinforcement learning
Electric vehicles charging
Vehicle-to-grid
Power system management
status_str publishedVersion
title Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
title_full Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
title_fullStr Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
title_full_unstemmed Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
title_short Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
title_sort Electric vehicles charging management using deep reinforcement learning considering vehicle-to-grid operation and battery degradation
topic Engineering
Automotive engineering
Control engineering, mechatronics and robotics
Electrical engineering
Information and computing sciences
Machine learning
Distribution grid
Optimization
Deep reinforcement learning
Electric vehicles charging
Vehicle-to-grid
Power system management