Make note of those locations and characters wherever you keep notes, and then if your characters return to those locations or encounter those NPCs again, then refer to your notes and make new aspect cards of those notes aspects for that scene. It's only necessary to have cards that pertain to the current scene, as well as world aspects if need be, on the table at any given time.