How can I get a folder from remote machine to local machine?

I am trying scp -r usernameipaddress:/path /pathwhereIwanttocopy, but I am getting it as connection refused.

How can I get it? How can I get connected?