NEIS 2022 - Conference on Sustainable Energy Supply and Energy Storage Systems

In recent years, electric vehicles (EVs) are considered to be a promising way to reduce greenhouse gas emissions from the transportation sector. However, the increasing penetration of EVs into the distribution network (DN) raises serious concerns about the network’s safe and reliable operation. The uncontrolled EV charging with random behavior will lead to volatile load peaks on the distribution transformer. In order to obtain more transformer loading capacity available for integration of further EVs, distributed energy resources (DERs) and related devices, such as heat pumps, the transformer loading must be limited to a certain range. For this reason, an intelligent charging management based on model-free Reinforcement Learning (RL) is proposed in this work. The RL management is able to control the charging power of all EVs connected to the network without previous knowledge about the arriving- and leaving time. The needed information for the RL-agent to perceive the current state of the system is formed with cumulated values such as the total energy requirement and the total charging power demand of all EVs. In this paper, the RL algorithm is trained on real-world energy consumption data for a month and on a reference network, created with selected characteristics of a substation network area in the northeast of Hamburg. Comparing with uncontrolled charging, the simulation results show that the RL-based charging management avoids 99 % of threshold violations regarding transformer loading and results in 1% of EV energy requirement is not satisfied. Through sensitivity analysis regarding the state space representation in the employed RL process, the necessity of providing the state of charge (SOC) or the energy requirements of EV users are proven to improve the charging control performance.

To meet ever-stricter climate targets and achieve the eventual decarbonization of the energy supply of German industrial metropolises, the focus is on gradually phasing out nuclear power, then coal and gas combined with the increased use of renewable energy sources and employing hydrogen as a clean energy carrier. While complete electrification of the energy supply of households and the transportation sector may be the goal, a transitional phase is necessary as such massive as well as rapid expansion of the electrical distribution grid is infeasible. Additionally, German industries have expressed their plans to use hydrogen as their primary strategy in meeting carbon targets. This poses challenges to the existing electrical, gas, and heating distribution grids. It becomes necessary to integrate the planning and developing procedures for these grids to maximize efficiencies and guarantee security of supply during the transition. The aim of this paper is thus to highlight those challenges and present novel concepts for the integrated planning of the three grids as one multi-energy grid.

Dynamic and abrupt changes in the energy sector of the EU countries point to the need for significant optimisation and more flexible energy consumption patterns. Since the implementation of Energy Management System in the residential sector of Germany is still in an active development phase, the aim of this paper is to consider the application of the widest possible range of sensors whose performance is applicable with the Energy Management System and the German Advanced Metering Infrastructure to maximise the efficiency of Energy Management processes, load flexibility and the functionality of the Energy Management System. The resulting Energy Management System results have been tested and validated with a Hardware-in-the-loop simulation on the Opal-RT simulator, indicating the potential for energy optimisation and interoperability with the Advanced Metering Infrastructure.