Mary’s father was Symons Sympson who bought Banwell Castle in Somerset in 1847. His son, Joseph Dyer completed the building of the mansion house.