Rappahannock Academy is an unincorporated community in Caroline County, Virginia, United States. Rappahannock Academy is located on U.S. Route 17, 13 miles (21 km) southeast of Fredericksburg. Rappahannock Academy has a post office. The community was named after the Rappahannock Academy & Military Institute, a now-defunct military academy in the community.