During the
American Civil War, Culpeper County voters again elected James Barbour to the Virginia House of Delegates; he served during the sessions 1861/62, 1862 (April), 1862 (September), and 1863 (January). However,
John H. Rixey succeeded him for the session which began on September 7, 1863. After Virginia's secession, Barbour volunteered to serve in the Confederate States Army and was commissioned as a major on the staff of General
Richard S. Ewell, where he served as an assistant adjutant general. After a dispute with General
Jubal Anderson Early, Barbour resigned on January 30, 1863. Other sources cite ill health as Barbour's reason for resigning. About six months later, the
Battle of Brandy Station, perhaps the largest cavalry engagement of the conflict, took place on and around the Barbour family's estate. Beauregard mansion is now colloquially known as the Graffiti House because it contains
graffiti inscribed both
Union Army and
Confederate States Army soldiers. ==Later life==