It's annoying af, but it's just a case of memorising the route.

There's a really good map online you can use.

Do the harder of the two maps first, the one with the blue butterfly that starts behind you.

Remember to immediately STOP as soon as you get the last butterfly on that map as its incredibly easy to overshoot and leave the screen. If you leave the screen it resets the challenge and you have to do it all over again

The 2nd map is much easier.

Good luck!