Don't push it.
It should turn the button to "out of stock" and not clickable when stock = 0 (zero) and tracking is 'on'. I have tested it and it works on my machine.
It must be your luck day. Should be fixed in v1.11