Washburn's first reading room and library was organized in 1891 and shortly thereafter moved into the new city hall. Throughout the next decade the city grew and expanded. Likewise, the library collection soon outgrew its existing space and funds were requested from the Carnegie Foundation for a new building. Construction on the new, larger library building began in 1904. Northern Wisconsin master architect Henry Wildhagen, best known for his school designs, was given the commission.

Wildhagen designed the library in the Neo-Classical style, setting the building on a raised basement of coursed, rock-faced brownstone, which was one of the region's major industrial products. Tall Ionic columns support the projecting front entry portico. The triple windows on each side are joined by a continuous sill creating symmetry of design that is reinforced by the paired brick chimneys on both the north and south ends of the building.

The main floor plan follows a typical Carnegie library design. A vestibule serves as an entrance into the main level with a central circulation desk that separates the adult and children's reading rooms. A pair of dog-leg stairs descends to the basement where there is a large meeting room that occupies the center.

The library is still in operation and is open during regular hours.