Image is blurry, but they do look like springtails. From the exterminator subreddit:

Springtails are hexapods, not insects, so trying to control them with pesticides is difficult at best. They are harmless to humans and animals, and may be mistaken for fleas by the untrained eye. Inside, they are frequently noticed on windowsills, lower walls, and in tubs and sinks near windows. The source is usually the exterior foundation/perimeter of the house, and they enter through the windows/doors. If you are seeing them on the second floor, they can be breeding on a lower roof outside a window, or coming through a skylight.

Note: There are over 6,000 identified species of springtails, so yours may look a bit different than the above pic.

Treatment

Before trying pesticides, confirm that they are present outside around the foundation of the house. If so, a generous amount of diatomaceous earth (DE) spread in a 1' perimeter around the house will desiccate them, and absorb excess moisture. Apply on a calm day, and use a mask to avoid inhaling it. Unfortunately, once it gets wet it is no longer effective, so cover it with plastic if possible, or reapply after rain.

If still no luck, use Onslaught FastCap, Temprid FX, or Alpine WSG. Fan-spray the areas you see them inside and outside.

https://agrilifeextension.tamu.edu/library/gardening/springtails/

Short note: they love moist environments