awscli doesnt work on WSL2

I managed to install awscli on WSL1. I can query my s3 bucket, copy and move data to/from my buckets just fine. However, when I convert to WSL2, awscli doesnt seem to work. If I issue

aws s3 ls

I would get

Could not connect to the endpoint URL: "https://s3.us-west-2.amazonaws.com/"

I tried different region, and it would fail. But as soon as I convert back to WSL1, it would work again.

How can I get my awscli to work on WSL2 ?