OpenSSH runs on windows server as well. You can definitely SSH in to run commands.

Or just use VSCode to run remote terminals and never leave your own VSCode instance to fully manage all your servers, Windows and Linux.