Are you using email piping or polling? If you're polling, check the intervals on your cron job, or if you're using auto-cron, set up a cron job instead.
Or better yet, use piping and that will solve the problem...
Unless you're already using piping, in which case, it's down to your mail server.