The history of the town goes back to 1830 when Dr. Edward Gantt discovered white marble and was one of the first towns in the county. A block of marble from the area is in the
Washington Monument. The 1930 census showed a population of 542 but the Great Depression and dwindling demand for marble used in building construction began the town's decline. In 1940 the population was 456 and by 1973 it was down to 63 residents. According to the 1990 U.S. Census, the incorporated town of Gantt's Quarry had a population of seven. By the time of the
2000 census, the town shows a population of zero, and much of it appears to have been annexed into the city of
Sylacauga. Preventing such an annexation was most likely the reason the town incorporated in the first place. ==Demographics==