When I have only non-shippable items in cart, and the delivery pane is hidden upon checkout, the taxes are calculated according to the default shipping address (the store address).