If you filed or paid late, you may qualify to have IRS abate your penalty. Under its First Time Abate program, if a filer has paid or arranged to pay the tax due and has been tax-compliant for the past three years, IRS will OK a one-time waiver of the late payment and late filing penalties. The penalty for late payroll tax deposits is also covered. This hasn’t been widely publicized . . . . taxpayers must ask for the relief.