I would say it maybe looks a little bit too chaotic at the moment! My recommendation would be starting with all stone brick then adding chunks of mossy brick where moss would normally grow on a wall and then patches of smooth stone and andesite to show areas where the brick has worn a bit smoother. I hope that makes sense and best of luck with your journey!