In 1882, Ivy Club took the bold step of erecting its own clubhouse on a lot on the north side of Prospect Avenue, where Colonial Club stands today. Frederick B. White designed the structure, a modest cottage in the Queen Anne style. The first floor was clapboard, with shingles on the second floor; it had two porches below and one above, which also featured an intricate beaded screen.