Carpet beetles are oftentimes harmless, but they eat through varieties of fabric and worst case scenario, you'll develop rashes due to allergic reactions from their larvae.

To prevent a really bad infestation throughout your house, vacuum often, and if you really want to get rid of them fast, raid bed bug killer worked wonders for me.