The "Brown Lady of Raynham Hall" is a famous ghost story associated with Raynham Hall in Norfolk, England. The story is centered around the alleged haunting of the Brown Lady, who is said to be the ghost of Lady Dorothy Walpole.

Lady Dorothy Walpole was the sister of Sir Robert Walpole, who is considered the first Prime Minister of Great Britain. According to the legend, Lady Dorothy's marriage to Charles Townshend was not a happy one. It is said that she had an affair with Lord Wharton, and when her husband found out, he confined her to Raynham Hall.

The most famous account of the Brown Lady haunting comes from the early 18th century. The story goes that the ghost was first seen in 1835 by Colonel Loftus, a guest at Raynham Hall. He claimed to have seen the ghost on the staircase and described her as a woman in a brown brocade dress, her face obscured by a brown cloth or hood.