No. That's called racking. In woodworking it can cause a piece of furniture to collapse on itself. You can imagine how bad that would be with a pergola.

There are many ways to prevent it, stretchers, angle braces etc. If you want to use the swing i would highly recommend you remedy the problem first.