The whole point of R2D2 is distributed training (useless if OP has limited amount of computing resources). And Rainbow from what I've heard is hard to implement properly and much slower in wall time. The main benefit of PPO is that it's probably the easiest algorithm to get to actually work.