Born in Ann Arbor, Michigan, O'Hara attended the College of Notre Dame and joined the Holy Cross congregation in 1912. He later served his alma mater consecutively as Prefect of Religion, Vice President, and President. Ordained bishop in 1939, he was given the see of Buffalo in 1945, then Philadelphia in 1951. He was made cardinal in 1958.