Joseph McCabe believed in God, but he renounced bigotry and became an Agnostic.

There are many men such as Joseph McCabe who have given up their profession of a belief in God. But, they do not give up that belief because Agnosticism offers them a higher and holier life. They find Agnosticism less irksome, whether it be by emancipation from moral laws, or from the restraints of truth and logic. Nor should you talk of bigotry. Many Agnostics have a far worse bias than that which they attribute to believers, garbling facts and distorting evidence without any of the scruples which one who really believes in God would certainly experience.

Radio Replies Volume 1 by Rev. Dr. Leslie Rumble MSC and Rev. Charles Mortimer Carty