Meantime he remained in his seclusion. His unpopularity did not, however, decrease in his absence. More than a year after his departure, Berlaymont said the nobles detested the Cardinal more than ever, and would eat him alive if they caught him. The chance of his returning was dying gradually out. At about the same period Chantonnay advised his brother to show his teeth. He assured Granvelle that he was too quiet in his disgrace, reminded him that princes had warm affections when they wished to make use of people, but that when they could have them too cheaply, they esteemed them but little; making no account of men whom they were accustomed to see under their feet. He urged the Cardinal, in repeated letters, to take heart again, to make himself formidable, and to rise from his crouching attitude. All the world say, he remarked, that the game is up between the King and yourself, and before long every one will be laughing at you, and holding you for a dupe. Stung or emboldened by these remonstrances, and weary of his retirement, Granvelle at last abandoned all intention of returning to the Netherlands, and towards the end of 1565, departed to Rome, where he participated in the election of Pope Pius V. Five years afterwards he was employed by Philip to negotiate the treaty between Spain, Rome, and Venice against the Turk. He was afterwards Viceroy of Naples, and in 1575, he removed to Madrid, to take an active part in the management of the public business, "the disorder of which," says the Abbe Boisot, "could be no longer arrested by men of mediocre capacity." He died in that city on the 21st September, 1586, at the age of seventy, and was buried at Besancon.