If you need multiple identities for multiple servers, you need to add them in the config file, as follow
vi ~/.ssh/config
IdentityFile ~/.ssh/id_rsa
IdentityFile ~/.ssh/id_rsa.server1
IdentityFile ~/.ssh/id_rsa.server2