The Rectory was destroyed by the fire of 1853, which seems to have begun in the Rectory and moved to the Novitiate and then to the Chapel. Restoration began in 1853. The addition of the front part of the rectory (present Rectory) began in 1870 and was completed in 1874. The rear of this building, prior to the renovation, was comprised of two rooms on the first floor, the one on the south for the kitchen with fireplace and the one on the north for the refectory (dining room), also with fireplace. Above these two rooms were two small rooms with a hallway leading to a covered back stairs, with a step up into a second floor hallway in the newer front section. A sloping roof that dropped from front to back about 7 1/2 feet to 6 feet covered the rooms in the back. The front of the building with its mansard roof was added in the fashion of the "telescope" houses of the period. The ceilings of the rooms are 9 1/2 feet high. The present dining room was a small "domestic" chapel, used during cold weather, since heating the larger chapel was expensive and entailed a very early rising to get the system going.

The "Old Rectory" attached to the rear of the present Rectory, had to be taken down in 1979 after a structural engineering survey indicated that it couldn't be saved except at great expense. The beams of the old house were very sturdy, hand crafted and shaped with an adz and held together with wooden pegs. Two of the beams form the cross cabinetmaker, into the Altar of Reposition (Chapel) at the Main Church. Fr. John F. Hogan later restored and remodeled the Rectory.