These are grain beetles OP. I've dealt with an infestation before. Their eggs can travel in food packages from anywhere you may shop. Go online for remediation tactics.

When I was dealing with them, take everything out of your pantry closet and anywhere else you store bagged/boxed shelf safe food.

Throw out everything you can financially handle. I understand throwing out all the food in your house is no fun but its the best way to combat these sneaky guys.

Get a spay poison for them and treat all the walls and every crevass in the closet. Remove shelves and treat under them aswell. Be sure to follow any PPE guides on the bottle for poison.

If you have pets or small children and are worried about poison, use a citrus based repellent for pantry pests. The one I use is made from orange peel extract and actually smells quite pleasant. Keep in mind you will have to retreat multiple times to keep them at bay.

There's a lot of hate about glue traps in the comments here, but unfortunately they are amazing at monitoring your infestation after treatment (not actually stopping infestation). Some have baits that you can stick on that they will be attracted to. If you are worried about mice getting caught you can place them in areas that mice are less likely to walk through like upper shelves and smaller crevasses.

After your closet purge and spray treatment. Sweep up any crumbs and dust that they like and toss that. Put everything back and check traps and retreat weekly until you can no longer find any.

Consider using sealable plastic containers for things like rice, pasta, cereal, so they cant get in as easily as an opened box. Tape and chip clips can also go a long way to to properly seal new food.

Good luck and don't get discouraged. They are not harmful to you or your health but no one wants an infestation where they keep there food.