There is a similar question about slow logins here, but I believe my issue is different. Read on...
I usually use my Pi headless, SSHing in from my Macbook over WiFi. When I do, it usually takes 10-20 seconds for the password prompt to appear. While it isn't the end of the world, it is annoying.
I ran the ssh command with the -vvv parameter and this seems to be where the problem is:
debug1: Trying private key: /Users/Name/.ssh/id_rsa
debug3: no such identity: /Users/Name/.ssh/id_rsa
debug1: Trying private key: /Users/Name/.ssh/id_dsa
debug3: no such identity: /Users/Name/.ssh/id_dsa
debug2: we did not send a packet, disable method
debug3: authmethod_lookup password
debug3: remaining preferred: ,password
debug3: authmethod_is_enabled password
debug1: Next authentication method: password
It seems it is looking for keys that are not there before finally asking for a password (where I have placed Name is actually my Macbook user name). As that path is obviously on my Mac I assume the problem lies that way, but I don't know - it could be the Pi. Performance is fine once I've logged in. Does anyone have any suggestions?