Two miles south-west are the earthwork remains of a motte-and-Bailey castle known as Castle Orchard.
The civil parish of Stourton with Gasper consists of three ancient manors: Stourton, Bonham and Gasper. Bonham and Gasper were in Somerset until 1895, when a boundary revision passed the entire parish to Wiltshire. The 2001 census recorded a parish population of 201.
Stourton is home to Kilmington and Stourton Cricket Club who play in Division Two of the Somerset Cricket League.