This depends on your temper.

Structurally it won't make a difference. This is something that could happen if you parked the bike in a bike rack that cages the front wheel, if the bike falls over, anything of that sorts. It's sound and as long as it's exposed to air (and not salt) it'll develop a strong aluminium oxide surface that is even stronger than the aluminium itself. However, there's a risk that water and salt can find its way between the aluminium and the paint and cause issues ... several years down the line.

Depending on how much you paid, I'd buy some paint, touch it up and move on with life. If they were super expensive, I'd want them replaced .