A co-worker said he even filed taxes a year late one year, and they didn't mind at all.

I filed one year's taxes 3 years late -- the max here in the US. They only owed me $100, though.

I would definitely recommend lowering your deduction.