In 1864 he was elected grand master of the Grand Lodge of Free and Accepted Masons for the state of New Hampshire, and was re-elected the next year. After this he declined a re-election. He has for many years been an active member of the New Hampshire Historical Society, and for the last five or six years has been one of its vice-presidents. For some years past he has been connected with the National State Capital Bank as one of its directors. The Loan and Trust Savings Bank at Concord commenced business August 1, 1872, and in the nine years since then its deposits have increased to over a million and a quarter of dollars. Judge Sargent has been president of this bank, and one of its investment committee since its commencement, and has given his personal attention to its affairs. In 1876 the New Hampshire Centennial Home for the Aged was organized and incorporated, and January 1, 1879, a home was opened in Concord. Judge Sargent has been president of this institution four years, and has taken a deep interest in its prosperity and success. About the 1st of September, 1879, at the end of five years from the commencement of his partnership in business, he retired from the practice of law. Since he commenced the practice of the law, in 1843, his residence has been as follows: In Canaan four years, to 1847; in Wentworth twenty-two years, to 1869; and in Concord since. The judge has acquired a competency, has one of the finest residences in the city, and is enjoying life with his friends and his books. Judge Sargent married, first, Maria C. Jones, of Enfield, daughter of John Jones, Esq., November 29, 1843, by whom he had two children. John Jones Sargent, the elder, graduated at Dartmouth College in 1866, and died in Oshkosh, Wisconsin, October 3, 1870, just as he was ready to commence the practice of the law. The second, Everett Foster, died young. For his second wife, he married Louisa Jennie Paige, daughter of Dea. James K. Paige, of Wentworth, September 5, 1853, by whom he has had three children,--Maria Louise, Annie Lawrie, and George Lincoln. The second died young; the eldest and youngest survive.