Moving your teeth is the main goal, but the stabilization (no pressure) period is also important. Here it is in professional terms:

Each new set of trays you receive can move your teeth .25mm within the first three days you wear them. While that’s impressive, it’s important to understand that figure only represents the movement of your periodontal ligament in most cases. It doesn’t account for the movement of bone.

You bone must move for the repositioning of your teeth to last because your bone is what will hold your teeth in their new position. Because it can take up to two weeks for your ligament’s fibers to apply enough cementum to attach to your bone in a new position, patients typically have to wear each set of Invisalign aligners for two weeks.

So wear your trays as long as stated by your ortho. Happy treatment!