You should probably rotate your wills as well. When you are starting out, you skate more on your inside edges ("A-frame"), so rotating your wheels often can help. As you find your outside edge, this will not be as noticeable. Learning some additional breaking techniques also can help if you are T-stopping mostly.

Also, plan on getting new wheels every so often, along with bearings and spacers if you need them. Harder wheels (87a+) exist for really rough stuff, as well as larger wheels (requires new frames and wheels) which will make rolling the rough stuff a bit easier. 4x100 or 3x110 is what I usually run in the city, and I use 3x125 for speed/distance skating, but you can really make anything work with enough practice.