The year which followed the Restoration was to Lord Willoughby a year of sorrow, and the joy with which he had greeted that event was quickly overshadowed by a great domestic affliction. Ere a year had rolled round from the time when Charles landed at Dover he lost, within the short space of a few days, both his eldest son and his wife. Samuel Hartleb, in two of his letters written at the time to his friend Dr. Worthington,[13] alludes to these painful events. Writing on March 26, 1661, he says: "My Lord Willoughby's eldest son is dead. My Lady Willoughby is also dangerously sick, which is all I have to add;" and a week later he writes: "His (Mr. Brereton's)[14] mother-in-law (Lady Willoughby) is dead also." Shortly afterwards Lord Willoughby was appointed to the governorship of Barbadoes, a post he continued to hold until 1656, when he was unfortunately drowned during a hurricane that swept over the island, an occurrence that Pepys thus alludes to in his "Diary:"-- November 29th (1666). I late at the office, and all the news I hear I put into a letter this night to my Lord Brouncker at Chatham, thus--"I doubt not of your lordship's hearing of Sir Thomas Clifford's succeeding Sir H. Pollard in the Controllership of the King's house; but perhaps our ill (but confirmed) tidings from the Barbadoes may not have reached you yet, it coming but yesterday; viz., that about eleven ships (whereof two of the King's, the Hope and Coventry), going thence to attack St. Christopher's, were seized by a violent hurricane and all sank, two only of thirteen escaping, and these with loss of masts, &c. My Lord Willoughby himself is involved in the disaster, and I think two ships thrown upon an island of the French, and so all the men (500) became prisoners." Lord Willoughby having no surviving male issue, the titles and estates devolved upon his younger brother, William, who, in 1672, was also appointed Governor of Barbadoes, and to whom Evelyn, in his diary, thus refers:-- April 16th (1672). Sat in Council preparing Lord Willoughby's Commission and instructions as Governor of Barbadoes and the Caribbé Islands. He died at Barbadoes, April 10th, 1673, having held the post barely a year. His lordship married Ann, one of the daughters of Sir Philip Carey, of Stanwell, county Middlesex, who bore him with other issue, three sons--George, his heir, and John and Charles, who eventually through failure of direct descent successively inherited the honours of the house.