The house now known as the Manor House stands opposite the east end of the church. It was formerly known as Brook or Brooke House and the name was only changed in the late 19th century.

The house is first mentioned (as Broke House) in the reign of Elizabeth I in a grant dated 1589, but this was an earlier building, though some parts of it are incorporated in the present house. Arthur Oswald thought that the interior wall parallel to the front outside wall and fireplaces in two of the bedrooms may come from the Elizabthan house. The house was substantially enlarged and rebuilt in the mid-17th century.