What version of vCO are you using? If using vCO 5.1.x, have you tested using the Library workflow: "Retrieve messages (via MailClient) ?
Does your mail server require SSL connection? If so, have you imported the SSL Certificate into the vCO using the Configuration page?