Castor Tower Mill is thought to date back to the early 1800s although exactly when it was built is unknown. It was known to be in active use as a corn mill until 1898, after which all milling activity was switched to the nearby water mill. By the early 1930s, all parts deemed potentially dangerous to nearby walkers were removed thus leaving the stump pretty much as it looks today.