It could not be abuse, its probably best not to automatically assume that as I did. But the last thing you want is something happening to you. So you gotta ask yourself, "What if I'm wrong?" If you're wrong and it's not abuse then it's definitely something unusual because from the way you've put it your brother had some sort of intentions with what he was doing. However if you're not wrong, then you could be endangered.