The probe comes after a May report from the Treasury Inspector General for Tax Administration found rising rates of tax delinquency in the federal workforce.