Answer by thrig for After setting up ssh-keys, how can I ssh into the server such that the key-pair will be ignored?

You can turn off public key authentication on a per-connection basis (and also disable connection sharing so that the new session does not connect over an already established one) via:

$ ssh -o ControlPath=none -o PubkeyAuthentication=no serverhost