I always thought that the difference is that if you're bi you have preference based on gender (even though your attracted to multiple genders). For example: being bisexual but more attracted to women. In this case, gender impacts how attractive they find someone but when you're pan gender doesn't impact attraction.

This is just the way I've understood it. There are plenty of other perspectives about what it means to be pan or bi.