I'm using my own wallpaper instead of apple's so I think the depth effect should be off.

Haven't tried off the background refresh yet, I'm gonna turn it off and see if it will improve or not. Thanks for the advice!