So popular did he become that he was elected to Congress in 1782, being one of the youngest and most popular members. Later on he became Treasurer of State, succeeding his father in this work. He was made Governor of New Hampshire, which office he held for fourteen consecutive years and later on accepted the nomination for two years more. In 1816 he declined the election, giving as an excuse that he preferred to spend his remaining days in quietness. This Governor Gilman was a portly man, weighing two hundred pounds and standing six feet in his stockings. He was a dignified old gentleman, preserving his vigor to the very end. While the latter part of his life was spent in renewing social relations with his friends, the memories of the past were always with him, and he was never so happy as when he recalled the days of Washington, who was a personal friend. Strong and original in intellect, few men were able to foresee as he did the future of his country. It is said that the night before his death he was brought downstairs by a faithful old negro retainer to spend his last evening with his family. He had a clear realization that his time was drawing near, and he gave full instructions to his family concerning his burial and the manner in which they should cherish his memory. He requested particularly that no one should wear mourning for him--"Spend upon the living, not the dead," he said. After a short time he was reminded that he was getting very tired, and he left the room remarking: "I have no disposition to leave this precious circle. I love to be here surrounded by my family and my friends." He commended them to God, saying: "I am ready to go and I wish you all good night." The brothers of this noted man also held positions in State affairs and in the militia. His brother Nicholas at one time lived in this house. He occupied the position of lieutenant, captain, adjutant, and adjutant-general in the Revolution, being also a member of Congress. He took his seat in the United States Senate on March 3, 1797, and came out in views a solid Federal. Governor John Taylor Gilman, who succeeded his father, Colonel Nicholas, had eleven children, many of whom were married in the State Room of this house, which is so closely connected with the political events of the Revolution and where so many distinguished guests have been entertained.