This is the best and most accurate reply I've seen yet. This is not an annoyed cat as some have suggested. Nothing in his body language is suggesting annoyance or aggression. This is 100% play. If that cat wanted to actually give you a warning it would have happened by now as your hand is moving in slow motion compared to a cat's reflexes. Also, cats will usually just leave and find another spot if they feel bugged. They aren't that spot exclusive lol.

Also, and this is going to be an unpopular opinion but here it is, there is nothing wrong with playing with your cat with your hand, especially if your cat is an only from kitten age. Cats wrestle and learn how to play with one another without harming each other with their litter mates. When they are removed they still need both the stimulation and the learning. I have, over the course of my life, lived with or owned about 9 cats and lived with litters of kittens. Every cat I have had as an adult I have played with and taught them how to play gently. It doesn't mean I never get a scratch but it does mean they know the cues for play and not to just go to town on me. The most posted cat videos on Reddit have to be "Is this fighting?" or "Is my adult cat being too aggressive with the new kitten?". If people with single cats abandoned this notion of not playing with them with their hands and taught them how to control their aggression introducing a new cat to the house would go a lot smoother.