The manor of Cadeby was held in medieval times by the Norman baronial Fitzwilliam family, and later by their descendants, the Copley baronets. Later, it was inherited by barrister Thomas Levett, a native of High Melton, who sold to his brother, York barrister John Levett, who in turn sold it to Edmund Hastings, Esq., of Plumtree, Nottinghamshire.