Saint Peter's Church was the first Catholic church built within the city of Poughkeepsie. Many of the workers who built the railroad along the Hudson River were Irish immigrants. The church was built close to the river. When a later wave of immigrants came from Italy, a second church was built around the corner and named Mt Carmel.

Photograph