The Latin Mass Community of Jersey City grew out of Holy Rosary parish in Jersey City by those who were attached to tradition of Holy Mother Church. Beginning around 1995, this group sought access to the Extraordinary form of the liturgy. On Pentecost Sunday, 2002, the ancient liturgy was restored to Holy Rosary by its pastor, Monsignor Chiang, with the support of Fr. Kenneth Baker, SJ.
In 2014, the Latin Mass community moved from Holy Rosary next door to St. Anthony of Padua parish, where it continued to grow in numbers and in zeal. With the direction of Fr. John A. Perricone, the community established adult catechism classes, lectures on St. Thomas Aquinas, an Altar Guild, and the 501(c)(3) nonprofit organization Cantantes in Cordibus, Inc., a volunteer choir dedicated to the preservation and promotion of sacred music.
Since then, the Latin Mass community has found a new home in Assumption All Saints parish. It also continues to reintroduce the extraordinary form of the Most Holy Sacrifice of the Mass to new places in Jersey City where it has not been celebrated in decades, including the parishes of St. Paul the Apostle, St. Mary, St. John the Baptist, and St. Joseph.
Cantantes in Cordibus, with the current removal of direct parochial support, now underwirites costs directly associated with the liturgy, such as the purchase of candles, incense, and the provision of priestly stipends.