Born in Deerfield, Massachusetts, into a distinguished New England family, Starr was well educated and became an artist and tutor. During a stay in Philadelphia, she befriended Bishop Francis Kenrick, and converted to Catholicism in 1854. She was the first woman to received the Laetare Medal from the University of Notre Dame (1885).