Since there is no problme in HTTP/FTP download, most probably this is an issue with DNS. you may want to capture wireshark traces and find out if DNS response time is the culprit. it will also help...