Bismarck had wanted to marry Princess
Elisabeth zu Carolath-Beuthen in 1881, but his father would not allow it, as she was a Catholic divorcée and was ten years older than Herbert. The Chancellor pressured his son with tears, blackmail and threats to disinherit him by getting Kaiser
Wilhelm I to change the primogeniture statutes. That experience left Herbert a very bitter and alcoholic man. He once shot five bullets through a Foreign Office window, to be told he may have hit someone. He replied, "Officials have to be kept in a permanent state of irritation and alarm; the moment that ceases they stop working". On 21 June 1892 in
Vienna, he married Countess Marguerite, Countess of Hoyos, a member of the originally Spanish
House of Hoyos from Hungary. She herself was half-English and a grand-daughter of
Robert Whitehead, the inventor of the
torpedo. They had five children: • Countess Hannah Leopoldine Alice von Bismarck-Schönhausen (1893–1971), married Leopold von Bredow (1875–1933) • Countess Maria Goedela von Bismarck-Schönhausen (1896–1981), married
Hermann Graf Keyserling (1880–1946) • HSH
Otto Christian Archibald, Prince von Bismarck (1897–1975), married
Ann-Mari Tengbom (1907–1999) •
Count Gottfried Alexander Georg Herbert von Bismarck-Schönhausen (1901–1949), married Countess Melanie, Countess of Hoyos (1916–1949) • Count Albrecht Edzard Heinrich Karl von Bismarck-Schönhausen (1903–1970), married
Mona Travis Strader (1897–1983). He was at his father's bedside when the latter died on 30 July 1898. He died in
Friedrichsruh on 18 September 1904. The capital of the German colonial administration of
German New Guinea was called Herbertshöhe (now
Kokopo) in his honor. ==Orders and decorations==