Lemke was a missionary in western Pennsylvania, where he assisted the aged Fr. Demetrius Gallitzin. He founded the settlement of Carrolltown. He also invited the first Benedictines to the United States, who came under the leadership of Fr. Boniface Wimmer and established St. Vincent's Abbey. Lemke joined the Benedictines and helped to establish St. Benedict's Abbey in Atchison, Kansas.