When cart is not shippable, taxes are calculated according to store address

Project:File product
Component:Code
Category:
Priority:normal
Assigned:Unassigned
Status:active
Description
Project: 
uc_file_product

When I have only non-shippable items in cart, and the delivery pane is hidden upon checkout, the taxes are calculated according to the default shipping address (the store address).