Born in Switzerland, Bapst came to the United States in 1848 and worked among the Abenakis of Maine. While stationed in Bangor, he became involved in a school controversy and was tarred and feathered by an anti-Catholic group in the nearby town of Ellsworth. He went on to become the first president of Boston College.