$ sftp -vvv Remote_IP

Connecting to Remote_IP...
OpenSSH_5.2p1, OpenSSL 0.9.8r 8 Feb 2011
debug1: Reading configuration data /etc/ssh_config
debug2: ssh_connect: needpriv 0
debug1: Connecting to Remote_IP [Remote_IP] port 22.
debug1: connect to address Remote_IP port 22: Operation timed out
ssh: connect to host Remote_IP port 22: Operation timed out
Connection closed

I set up an account for SFTP only access with a chroot. I tested that on the server and it works fine. The problem is, I could not get remote SFTP access to the server to work right. The example above is what I keep on running into.

I have been trying to figure out how to solve this problem for 2 days now. I am not sure if it have to do with /etc/ssh/sshd_config. Is it something that I am not aware of? I am hoping that you could help point me to the right place for this issue.