The bishops having so much to do at Lynn, and deriving from it so much of their consequence, it was natural for them to choose to reside in its vicinity: hence the origin of the castle, or palace of Gaywood. At what time it was first built cannot now perhaps be ascertained. We are told that bishop John de Grey (about 1200, or soon after) erected, or rebuilt, a sumptuous palace here, for himself and successors, where he much resided. Succeeding bishops continued to reside here, and to pay attention to the improvement of the grounds, as well as of the palace. A deer park, and a warren, appear to have been made here by bishop William de Raleigh, about 1240; who also granted liberty of common pasture to the Earl of Arundel and Sussex, and his men, from the park of Bawsey to the bridge of Gaywood, and the cawsey between the river of Bawsey and the wood of the said Earl. In 1388, bishop Spencer, abovementioned, had licence to embattle his palace of Gaywood. This seems to have been after his return from the crusade, or war, in which he had been engaged for Pope Urban, against his competitor Pope Clement, as he had been appointed commander in chief five years before. From the high spirit and wealth of this proud prelate, it may be presumed that Gaywood Castle made a very splendid and princely appearance in his time; and it is likely that the same might be the case long after, even till the reign of Henry VIII. when it was surrendered, together with the bishop’s rights and immunities at Lynn, into the King’s hands. It was soon after, with its appurtenances, granted to the Duke of Norfolk, and then probably pulled down. Its site, and the adjoining estate passed afterward to the Thoresbys of Haveless hall, in Mintling; and from them to the Wyches, of Hockwold; and latterly to Philip Case Esq.—and now are the property of William Bagge Esq. of Lynn. Of the castle, or palace of Gaywood, no more needs now be said, but that it is fallen, never more, in all probability, to rise, or recover the least portion of its ancient splendor and consequence. Besides the castles, or palaces above mentioned, there were formerly in this country many religious houses, of different orders, and some of them of considerable note: among which were Blackburgh priory, in Middleton; Castleacre priory; Westacre priory; Crab-house nunnery, by Maudlin; West Dereham Abbey; Flitcham priory; Massingham priory, and Pentney priory. Of these some were extensive and noble edifices, and had large possessions attached to them; but scarce any remains of most of them are now to be seen, and their very memory seems to be approaching fast towards oblivion. Such is the fate of the firmest fabrics: like those who constructed them, they were composed of perishing materials. SECTION III. _Further Account of the modern palaces_, _and other notable mansions in this country_.—_Houghton—Holkham—Rainham—Narford—Narborough—Oxborough_.