The son of a Presbyterian minister in Duanesburg, New York, McMaster converted to Catholicism in 1845. He bought the newspaper Freeman's Journal from Bishop John Hughes in 1848 and gained notoriety in its pages by criticizing Hughes and Catholic intellectual Orestes Brownson.