The mill stands on what was the outer bailey of Rayleigh Castle and was built around 1798.  By 1824 there were five windmills in the town.  This is the only remaining mill and it has been restored as a museum and exhibition centre.