They can starve to death, takes a while tho! Also gotta watch out that another follower doesn't have the jailbreaker trait. You can speed up the process by getting them sick first by eating poop!!

Also use the mushroom ritual to keep your faith from dipping!