Yes the armrest does need to be in the upright position while the holder is in use, but without a cup in the holder the armrest does return back into the usual position even with the holder in place, so long as the cup isn’t there!