Dear SUMO users,
Hello, I am currently learning reinforcement learning (RL) algorithms for traffic signal optimization.
I am utilizing the Ingolstadt21 network from the RESCO benchmark (2021 NIPS) for traffic signal optimization. When I run the SUMO simulation without applying an RL algorithm, it operates normally. However, when I apply RL algorithms like MPLight or IDQN, I observe that vehicles stop at specific intersections even though signals are assigned, causing the state to continuously increase.
The green squares in the attached image represent vehicles that are stopped despite having been assigned a signal, and their vClass is bus.
- The lanes that the stopped vehicles are supposed to enter have enough space.
- The RL algorithm allocates the signals, and the simulation changes the signals properly.
- No special events like traffic accidents have occurred.
RESCO benchmark URL : https://github.com/Pi-Star-Lab/RESCO
I am using Python 3.9 and SUMO version 1.20.
I am curious to understand why this phenomenon happens. I appreciate your kind response in advance.
Best regards,
SeokHwan, Choi
