Holland was educated by the Irish Christian Brothers and joined that congregation, but left in 1873 because of poor health. He emigrated to the United States in the same year. His involvement with Irish revolutionists fueled an interest in military technology, and he studied, taught, and worked in the field of nautical engineering for the rest of his life. He developed the first submarine formally commissioned by the US Navy, the USS Holland (1900).