Hultberg was first married to Hilary Blech. Then, they lived at New York's
Chelsea Hotel in the late 1960s. Seeking a relaxing environment, the couple bought a house off the coast of Maine on Monhegan Island in 1971 and split their time between New York City and Maine, Hultberg did not like to live year-round, particularly during the harsh winters, at Monhegan Island and moved to Portland in 1985. He asked Drexler to come with him, but she decided to stay on the island. They were estranged at that time of her death, He had a son named Carl R. Hultberg and Elaine Wechsler was his agent and partner. ==Career==