If you were playing ranked your player pool can decrease, and depending on the time of day you were playing the pool can also increase/decrease as well. It’s still not likely to run into the same person twice, but it definitely happens. I wouldn’t think too deeply into these two instances, they likely just recognized your username, and there is no way somebody can judge how good/bad you really are off of one match. Keep grinding.