This often happens and it kind of solves itself after a while or after reboots. But I would like to stop relying on luck and understand why one server can ping the other but not the other way around.
Notice that neither pings were working before one of them started working
Edit:
Just to add more information, the server that is not able to ping the other is a AD controller server. The other one is a regular windows server 2019 without anything on it.
