Early library history in Waterloo dates as far back as March 13, 1830 when a public meeting was called to consider the establishment of a public library. A constitution was drafted and the Waterloo Library Association was formed. Library records show that this library had 421 volumes by the end of 1833.
The Waterloo Historical Society was created April 9, 1875. The stated purpose was to form an organization "by which the early history of the village may be rescued from oblivion". Later that same year, the historical society was incorporated by New York State action to become known as the Waterloo Literary and Historical Society.
In January 1876, Thomas Fatzinger offered $5000 towards the establishment of a library by the Waterloo Literary and Historical Society. This necessitated a new act of incorporation which was completed on March 22, 1876. The name was therefore changed to the Waterloo Library and Historical Society.
On February 12, 1878, a lot 60 feet by 60 feet on the corner of Church and Williams Street was obtained. Plans for the new building were accepted in 1880, with Nichols and Brown of Albany as architects. The foundation was to be completed on or before June 1, 1881. The cornerstone was laid September 28, 1880.