I'm using Raspbmc on my Raspberry Pi as my torrent/media server. I want to backup ~/.xbmc and ~/.config/deluge by tarring them and rsync'ing them over to my Ubuntu laptop.
This all goes fine, but I have to enter the password each time, which I find cumbersome.
Because of that, I've generated a SSH key on my Raspberry Pi, and copied the contents of /home/pi/.ssh/id_rsa.pub to /home/ubuntu/.ssh/authorized_keys.
This works, but when I want to SSH from the Pi to my Ubuntu laptop right now, I get the message:
Enter passphrase for key '/home/pi/.ssh/id_rsa':
which is even worse. How can I make the Raspberry Pi remember this passphrase?