The library was built in 1902. This was made possible by a grant from Andrew Carnegie for the building and the gift of land from Frank Stout in memory of his father Henry Stout. The public library was named after these two benefactors.
In 1929, the library board purchased the property (the former Masonic Temple) adjoining the library in anticipation of future growth. The library was expanded to include that property in 1981.
In December 2008, the library embarked on a total renovation of the facility. The renovation was completed in September 2010.