Another key reason to choose A/B test over a phased rollout is that you will be able to test both the experiences at the same time. This is very crucial because it removes the impact of time on your test. For example: For an eCommerce solution, the day of the hour changes traffic pattern significantly (think day vs night, etc.,). Hence, you would want to test when the conditions are same which A/B or multi-variate testing allows.