The BlackBerry App checks our servers periodically to see if there's a new voicemail. This setting may have been disabled or set to a very large value.
Fix!
In the YouMail App, hit Menu > Settings > Alerts > Check Messages every > Then change it to a value you want (like every 5 minutes)
Force the App to manually check our servers by pressing Menu > Check Messages