The firm was only moderately successful; the children came fast. With his narrow income it was not possible for the father to give his boy the college education he desired; so at fourteen, fresh from the common schools, Samuel entered as a clerk the banking house of Prime & King. While still a mere lad, an old friend of the family asked him what he meant to be when he came to man's estate. "I mean to be one of the first bankers in the United States!" replied Samuel. At the age of twenty-two he became a partner in the firm, which was thereafter known as Prime, Ward & King. In a memoir of our grandfather, the partner who survived him, Mr. Charles King, says:-- "Money was the commodity in which Mr. Ward dealt, and if, as is hardly to be disputed, money be the root of all evil, it is also, in hands that know how to use it worthily, the instrument of much good. There exist undoubtedly, in regard to the trade in money, and respecting those engaged in it, many and absurd prejudices, inherited in part from ancient error, and fomented and kept alive by the jealousies of ignorance and indigence. It is therefore no small triumph to have lived down, as Mr. Ward did, this prejudice, and to have forced upon the community in the midst of which he resided, and upon all brought into connexion with him, the conviction that commerce in money, like commerce in general, is, to a lofty spirit, lofty and ennobling, and is valued more for the power it confers, of promoting liberal and beneficent enterprises, and of conducing to the welfare and prosperity of society, than for the means of individual and selfish gratification or indulgence." Mr. Ward's activities were not confined to financial affairs. He was founder and first president of the Bank of Commerce; one of the founders of the New York University and of the Stuyvesant Institute, etc., etc. In 1812 he married Julia Rush Cutler, second daughter of Benjamin Clarke and Sarah Mitchell (Hyrne) Cutler. Julia Cutler was sixteen years old at the time of her marriage, lovely in character and beautiful in person. She had been a pupil of the saintly Isabella Graham, and her literary taste had been carefully cultivated in the style of the day. One of her poems, found in Griswold's "Female Poets of America," shows the deeply religious cast of her mind; yet she was full of gentle gayety, loved music, laughter, and pretty things. During the first years of their married life, Mr. and Mrs. Ward lived in Marketfield Street, near the Battery. Here four children were born, Samuel and Henry, and the two Julias. She who was known as "the first little Julia" lived only four years. During her fatal illness her father was called away by urgent business. In great distress of mind, he arranged that certain tokens should inform him of the child's condition. A few days later, as he was riding homeward, a messenger came to meet him and silently laid in his hand a tiny shoe: the child was dead.