How to reinstall OpenSSH Server on Windows 11 and configure it to use Public key only for login?

I tried to configure OpenSSH to use key (instead of password) for authentication on a Windows 11 Pro box, I ended up with a broken OpenSSH installation that would not start the service anymore. I wrote a long story about it if interested.

I suspect that my previous struggles left OpenSSH pieces in the system that prevent it from being truly successfully reinstalled.

My question is: How do I completely remove OpenSSH (officially, it is installed as an Optional Feature.) so that I can reinstall it?

Or: has anyone been successful with the OpenSSH Preview package in Winget?

I will continue to try and write about my result if I get it to work.