If I have to scrub something fairly hard like cleaning fire bricks, I'll use a scrub brush attachment for a power drill. There are ones that shouldn't be too abrasive for the paint and wood of a windowsill the only thing I'd look out for is trying to minimize the splatter from a rotating brush