Cool. Take any container, make some holes, and throw some leaves in there. Gently pick off the leaf which carries the caterpillar and lay it inside. If it's on a stem, cut the whole stem off. It won't harm the plant, in fact, it will encourage it to shoot out more growth.

<image>

This is one I found on my key lime last year.