This is mostly for my reference but may be of use to other people
SSH Key Pair on Windows:
Generate key:
ssh-keygen
Transfer to Server/VM
cat ~/.ssh/id_rsa.pub | ssh user@host "mkdir -p ~/.ssh && touch ~/.ssh/authorized_keys && chmod -R go= ~/.ssh && cat >> ~/.ssh/authorized_keys"
Disable Password Authentication
sudo nano /etc/ssh/sshd_config
..
PasswordAuthentication no
..
At the top of config, there may be a include, check this configuration for password authentication also
Restart SSH Service
sudo systemctl restart ssh