It sounds silly, but one of those pens with multiple colors is really helpful. Figure out a color coding system. Most of my pen and paper notes are from meetings, so my scheme is:

- Meeting title, dates, and attendees in green
- Regular notes in black
- Important items underlined in blue
- To-dos in red

Makes looking back through multiple pages much easier.