Lady’s Tower was built in Ruby Bay, on the east side of Elie Ness, for Janet, Lady Anstruther in the 1770s.