Williams turned to a photographer and artist, Forster in Westmoreland Street, for advice. "His reply was concise and to the point and I never forgot it. Sit down in the first ditch you come to and try and paint what you see!" He remained largely self-taught, attending only the
Royal Dublin Society night school for some lessons in drawing and painted in oils and watercolours. He exhibited
Hard Times, a winter scene with birds painted from nature, at the
Royal Hibernian Academy annual exhibition of 1870, and had his first sales at the RHA the following year. He continued to exhibit at the academy every year until his death, Williams left the taxidermy business when he was appointed as an alto at Her Majesty's Chapel Royal,
Dublin Castle, having also sung with the Dublin Glee and Madrigal Union quintet. The following year he was one of the founder members and first secretary of the
Dublin Sketching Club. He also exhibited regularly with the Water Colour Society of Ireland, and contributed pictures to various other societies. Among his surviving papers is a diary that Williams kept between 1906 and 1913 of his time on Achill island. He was commissioned by Blackie & Son in 1911 to produce paintings used to illustrate a set of four books entitled
Beautiful Ireland. == Death and legacy ==