Olson's books include: •
Italian Drawings 1780–1890 (Indiana University Press, 1980) •
Fire and Ice: A History of Comets in Art (Walker & Co., 1985) •
Ottocento: Romanticism and Revolution in 19th-Century Italian Painting (edited, American Federation of the Arts, 1992) •
Italian Renaissance Sculpture (
Thames & Hudson, 1992) •
Fire in the Sky: Comets and Meteors, the Decisive Centuries, in British Art and Science (with
Jay Pasachoff, Cambridge University Press, 1998) •
The Florentine Tondo (
Oxford University Press, 2000) •
The Biography of the Object in Late Medieval and Renaissance Italy (edited with Patricia Reilly and Rupert Shepherd, Blackwell, 2006) •
Drawn by New York: Six Centuries of Watercolors and Drawings at the New-York Historical Society (Giles, 2008) • ''Audubon's Aviary: The Original Watercolors for The Birds of America'' (Skira Rizzoli, 2012) •
Making It Modern: The Folk Art Collection of Elie and Viola Nadelman (with Margaret Hofer, Giles, 2015) • Artist in Exile: The Visual Diary of Baroness Hyde de Neuville (Giles, 2019) •
Cosmos: The Art and Science of the Universe (with
Jay Pasachoff,
Reaktion Books, 2019) •
Scenes of New York City: The Elie and Sarah Hirschfeld Collection (edited and contributed, Giles, 2022) •
Audubon As Artist: A New Look at The Birds of America (Reaktion Books, 2024) ==Recognition==