Having the same issues... From what I can tell the best option right now is using hook_form_alter to pull addresses in from user profiles. I've settled on using profile_location (after having to back out of using addresses as it doesn't support views or any other profile/content stuff) and code from here:
http://www.ubercart.org/forum/development/900/pre_populating_shipping_ad...
hth