But a good many Anti-Slavery men who thought the party feeling of the Whigs and Democrats was a great obstacle to their cause, joined the movement simply in order that they might get rid of the old parties, and prepare the State as with a subsoil plow for a new one. They had no belief in the proscriptive doctrines, and were willing that men of foreign birth and Catholics should have their just rights, and expected to destroy the Know Nothing Party in its turn when it had destroyed Whiggery and Democracy. Of these was Henry Wilson, who owed his first election to the Senate to the Know Nothing Legislature; and Eli Thayer, who had been the organizer of the Emigrant Aid Society, and the movement for the deliverance of Kansas and Nebraska. Both these gentlemen abandoned the Know Nothing Party the year after its formation. Mr. Thayer was elected as a Republican to Congress in 1856, and reelected in 1858. But he separated from his political associates and espoused the squatter sovereignty doctrines of Stephen A. Douglas. He, I have no doubt, was a sincere Anti-Slavery man. But he liked to do things in peculiar and original ways of his own, and was impatient of slow and old-fashioned methods. So he got estranged from his Republican brethren, was defeated as a candidate for Congress in 1860, took no part in public activities during the time of the war, became somewhat soured, and landed in the Democratic Party. I always had a great liking for him, and deem him entitled to great public gratitude for his services in the rescue of Kansas from what was known as Border Ruffianism. Neither Charles Sumner nor Charles Allen ever tolerated the Know Nothing movement or made any terms with it. Its proscriptiveness and its secrecy were alike repugnant to their honest, brave and liberty-loving souls. Sumner was advised, as the question of his reelection was coming on in January, 1857, to keep silent about Know Nothingism. He was told that the Slavery question was enough for one man to deal with, and that if he would only hold his peace all the parties would unite in his reelection. He answered the advice with his brave challenge. He went about the Commonwealth, denouncing the intolerant and proscriptive doctrine of the Know Nothings. He told them: "You have no real principle on which you can stand. You are nothing but a party of Gardnerites." Charles Allen addressed a little company, of which I was one, in the City Hall at Worcester in the autumn of 1854, when Know Nothingism was in the height of its strength. He said: "Perhaps I am speaking too boldly, but I learned to speak boldly a long time ago. I will speak my sentiments in the face of any organization; or, if it does not show its face, though its secret mines are beneath my feet, and unseen hands ready to apply the match, I will declare those sentiments that a freeman is bound to utter."