The Old Synagogue was the first synagogue erected in Wisconsin and served the Jewish population of Madison. Samuel Klauber was the first Jew to settle in Madison and, by 1856, 17 families met to form a congregation. These families had come directly to Wisconsin from Europe. The congregation was originally named Ahavath Achim (Brother Love) but was later changed to Shaare Shomain (Gates of Heaven).

While trying to save money to construct a synagogue, the congregation held services in Klauber's house. In 1862, they purchased a vacant lot at 214 W. Washington Ave. on which to construct their building. They hired noted local architect August Kutzbock to design it and the building was finished the following year. Kutzbock, a German immigrant, designed the building in the Romanesque Revival style of architecture that he favored. He used Madison sandstone for the front of the building and buff brick for the rest of it.

The small congregation had a persistent problem securing the services of a permanent rabbi and in 1866 issued a call to Joseph Thuringer. He was the brother of one of the congregation's members and lived in Germany. Thuringer was not a rabbi but rather a well educated layman. He came and served the congregation until the late 1870s.

Money was also a constant problem for the small congregation, as was membership. At no time did it have more than 20 families. In 1879, the congregation started to rent the building to other organizations and eventually sold the building in 1916. The building was moved in 1971 to its present location in James Madison Park to save it from demolition.

The building is available to rent by contacting the City of Madison.