You do have to pay some taxes, but not others. Here’s how it works:

You do not have to pay the taxes for which you’re requesting an exemption as long as we’re processing your application. We call this a payment deferral. Do you pay by direct debit? If so, we’ll temporarily suspend the direct debit. 

You must still pay the taxes for which you cannot apply for an exemption by the payment due date.

Would you like to know exactly which taxes this applies to? For an overview, visit: Tax types eligible for remission.