Don't pause yet, unless you've actually run the numbers. Whether you end up with an actual penalty or not depends on a number of inputs like each of your actual incomes, deductions, how your benefit packages, insurance, and other things are structured. It sounds like you haven't actually run the numbers yet, and are operating out of FUD. Talk to a tax expert, or do some research, before despairing.