In 1766, he served under
Georg Adam von Starhemberg, as Second Minister of State, Member of the State Council (
Staatsrat) and Vice Chancellor. From 1766 he also served as Kaunitz' deputy foreign minister. With regards to imperial policy Pergen stood in opposition to
Kaunitz, whose policies represented an expansive development of the role of the Habsburg monarchy. Pergen had a good knowledge of the
estates of the realm from his time in Mainz and other embassies, and warned against a single policy for Austria. In 1766 he wrote a memorandum on the importance of the imperial crown for the House of Austria. In this he argued that the Emperor (Joseph) should demonstrate
Liebe zu Teutschland, and advised him to "defend the System with all [...] possible strength." This advice was not heeded by the Emperor. Aug 1770 On the urgency of removing Jesuits Pergen wrote, "..... Lay teachers immediately replace all Jesuits and other clerics, before the latter inflict more cultural damage on future generations". In 1770 Pergen was mainly responsible for education reform, under which the state itself should take responsibility for the school system. In contrast the clergy would lose its role in teaching and be replaced by laity, or at least secular priests. In addition, most subjects in the secondary schools would be taught in German. The schools would develop curricula, and
teacher training should be established. This would be financed from an endowment fund. This was anti-clerical and represented the reforms of the Enlightenment, which proved difficult to implement in the face of resistance from Maria Theresa and conservative-minded circles in the court. Between 1772 and 1774 he was Governor of the areas acquired in the first partition of Poland, in parts of Galicia (
Kingdom of Galicia and Lodomeria), working with the local Polish nobility. == Organization of police ==