[X-Unix] SSH without requiring password between 2 machines

[Our Pal Al]

I'm trying to enable SSH without requiring a password between my OSX 
machine and another OSX Mac.

On my mac  I used ssh-keygen to make an rsa key.
I copied the id_rsa.pub file from my ~/.ssh directory to the 
authorized_keys file in the ~/.ssh directory of my target Mac
On the target I edited /etc/sshd_config to uncomment  
"PubkeyAuthentication yes" and "AuthorizedKeysFile      
.ssh/authorized_keys", and then turned Remote Login of and on in the 
Sharing preference.

And yet, whenever I try to ssh to my target, I can't at all. I get 
"Connection closed by <remote ip#>"

What am I still doing wrong? For now I have to rename authorized keys 
to get in.

- opa