From his first wife Pauline de Meulan , His first son, François, was born on 14 August 1813 and died a few days later. A second son was born on 11 August 1815, François His father, especially after his widowhood in 1827, became intensely attached to him. After passing the competitive examination for the École polytechnique and studying law, he died of pleurisy on 15 February 1837.
6th August 1829, Eliza Dillon, the second Madame Guizot, gave birth to Henriette, She married Conrad de Witt on 18 March 1850 and had two daughters. She became housewife at Val-Richer and published numerous books and translations. She lived until 1908. Her father's letters to her were published in 2002. Her younger sister Pauline, born on 22 June 1831, married Cornélis de Witt, Conrad's younger brother, on 18 May 1850. She died on 28 February 1874, having given birth to seven children. Finally, on 11 January 1833, Eliza Dillon gave birth to Guillaume, He married Gabrielle Verdier de Flaux on 26 April. From 1870 to 1880, he was head of the Department of Non-Catholic Cults at the Ministry of Public Instruction and, from 1874, professor at the Collège de France. He died childless in 1892.