Agency inspectors general working under the assumption that the president can remove them for any reason could just as easily stick to routine audits of contracts and programs, rather than delve into controversial subjects.