Zend certified PHP/Magento developer

Can we use a server’s own private key to SSH into it?

I have a remote server:

hostname = rserver.com
port = 22
user = john

The remote server has a key pair id_rsa.john and id_rsa.john.pub stored in ~/.ssh/ with proper permissions.

Assume that I somehow get hold of the private key of the remote server (id_rsa.john).

Can I use the private key of the remote server (id_rsa.john) from my local machine to SSH into the remote server?