Even without Penn's assistance the union of the two Jerseys was bound to come. In 1701 it was pointed out by the Colonial Office of that day, that "by several letters, memorials, and other papers, as well from the inhabitants as Proprietors of both these provinces, that they are at present in confusion and anarchy; and that it is much to be apprehended lest by the heats of the parties that are amongst them, they should fall into such violences as may endanger the lives of many persons and destroy the colony."[188] It seemed obvious to those in London that some form of union was necessary to save the colony from this fate, and so New Jersey from the River Hudson to the River Delaware became a united province when the Proprietors surrendered all their political and territorial rights in 1702. For a short time New Jersey with New York suffered under the scandalous administration of the brainless and profligate Lord Cornbury, but his evil work was to a certain extent remedied by Governor Robert Hunter, who proved himself an able colonial administrator. The tract of land to which Penn had transferred his philanthropic schemes lay to the south of the river Delaware. It had been taken from the Swedes and at one time had been granted to Maryland, but up to the year 1681 it had remained unoccupied. The Quaker Penn, a man of high social position, friend and favourite of James II., readily accepted this piece of territory in liquidation of a debt of £16,000 owed to him by the Crown. The agreement now drawn up between Penn and the Duke of York was remarkable for its utter indifference to all constitutional forms. Penn was appointed Proprietor, but his powers were to a certain extent limited; on all legislative matters the Crown reserved the right of veto, and in all financial affairs the newly formed colony was to be regarded as an integral portion of the realm; while, as a further hold over revenue, an accredited agent of the colony was to reside in England and was to explain any infraction of the revenue laws.