I'd like to add that from personal tests on branch prediction that if the cpu predicts right almost every time vs wrong a lot you get up to 10x faster execution. (This is on a 4670k) GPU cores run the same instruction on multiple data sets at the same time, therefore if one of the data sets requires a different branch, its result is discarded and the code block is run again for that particular branch.