During his return to California in 1842, Howard married Mary Warren at the house of Captain
Grimes in
Honolulu. Mary Warren died in 1849, and Howard then married Agnes Poett, daughter of Dr. Joseph Henry Poett. They lived in a house and lot on the northeast corner of
Stockton and Washington streets, until 1851. He then moved to
Mission Street between Third and Fourth and built one of four cottages—of similar design and appearance. The others were constructed, one by George Mellus, one by Talbot H. Green and one by
Samuel Brannan. Howard died in 1856, at the age of thirty-seven, leaving one son (William Henry Howard) by his second wife. Agnes Howard survived her husband and later married his brother, George H. Howard. ==Legacy==