An interesting incident in this early period of his life was the part which he bore in founding the American Bible Society, in organizing its machinery for the immense work it had to perform, and in vindicating the principles of the society against the attacks of the opposing party in his own church. In this struggle Jay proved the independence of character and courage of conviction which afterwards distinguished him through the seemingly hopeless years of antislavery effort. The general distribution of Bibles in our day makes it difficult to appreciate the limited supply, the high cost, and the consequent rarity of the Bible when this society began its work. The High-Church party in New York were opposed to the association of Episcopalians with other Christians to circulate the Bible, and opposed even to the distribution of the Bible, unless accompanied by the Prayer-book as an interpreter. In these views they were vigorously supported by their distinguished leader, Bishop John Henry Hobart. Jay, who had inherited with his Huguenot blood a faith in the Bible not to be restrained by ecclesiastical assumption, was an officer of the Westchester Bible Society and deeply interested in the work. On the appearance of a pastoral letter from Bishop Hobart in which the High-Church views were expressed, he published a pamphlet showing that it was "the interest and duty of Episcopalians to unite with their fellow-Christians of all denominations in spreading the knowledge of the Word of God." This pamphlet brought him into an active conflict with the eminent bishop which lasted for several years, and taught him that a philanthropic cause, even so plainly meritorious, was not to be carried on without the opposition of powerful conservative interests.