The storage counters aren’t removed when you activate the mana ability.

You can activate City of Shadows’s second ability while it has no storage counters on it, though it won’t add any mana to your mana pool in this case. You’ve still tapped it for mana, though, in case any abilities (such as the ability of a Fertile Ground enchanting it) care about that.