Ferguson moved with his family to Liberia at age six. He was ordained a deacon on December 28, 1865 and a priest on March 15, 1868. He was consecrated as bishop on June 24, 1885 (Saint John the Baptist's Feast Day), at Grace Church, New York, becoming the first black member of the House of Bishops. He married Mary Leonora Montgomery.