Bayley was born of a prominent New York family, the nephew of St. Elizabeth Ann Seton. A convert from the Episcopalian ministry, he was ordained by Bishop John Hughes and served as his secretary until he was appointed ordinary of the see of Newark. In Baltimore he succeeded Archbishop Martin Spalding and was followed by Cardinal James Gibbons.