In February, 1803, as directed by Divine Providence, he removed with his family to Abergavenny, where he spent the remainder of his life. Here a new sphere was presented to engage his active zeal. Many were his efforts to do good, nor were those efforts vain. In April, 1807, he and Mrs. W. (his now surviving widow), with three other persons, were formed into the first English Baptist Church, in Abergavenny; the Rev. M. Thomas, who had recently resigned his charge at Ryeford, being pastor, and Mr. Wyke, deacon--a feeble, but devoted band. His active zeal, pecuniary contributions, and strenuous efforts were put under cheerful requisition to foster this infant cause; and, through the blessing of heaven, sinners were successively converted, and the church was edified and increased. Mr. Wyke continued an honourable member and deacon of this church about twenty years. In 1827, however, he and Mrs. Wyke, with several other members, withdrew from it; when they met for worship in a meeting-house which was kindly lent them in another part of the town. Soon afterwards, circumstances transpired that induced them to withdraw from this place also; and to commence, in Lion Street, the bold undertaking of erecting a new house for the worship of God. Mr. W. took the whole responsibility on himself; and in July, 1828, a neat, substantial, and commodious meeting-house, with suitable vestry and burial-ground, was completed. The Rev. Dr. Steadman, of Bradford, who had been intimately acquainted with Mr. Wyke from his earliest days, and the Rev. J. Edwards, now of Nottingham, a native of Abergavenny, preached at the opening; and on the following Lord's-day, a church of seventeen persons was organised, Mr. W. set apart to the office of deacon, and the Lord's Supper administered by Dr. Steadman. The property was invested in trust for the public; a mortgage of £200 only being left on it; and with the exception of this sum, the whole expense incurred was generously liquidated by Mr. Wyke. Long as our worthy friend retained any capability of effort, he laid himself out to promote this interest; and both the material building, and the spiritual house, here cemented in Christian love, present a striking monument of his liberality, and strenuous exertions to promote the cause of his God and Saviour.