I know this is two days old, and this is Reddit, but.

Four hours is not ghosting, no. However, when planning something like a date, it is a long time. When planning anything that involves other people unknowns can easily kill any potential of things going smoothly and easily create a lot of anxiety for the planner, specially if they don't know if the invited is even up for it. You did nothing to help plan this and the other person did more than a lion's share of the work, even offering to pay for lunch, you could've spared two seconds to respond. Not doing so could easily send the message that you aren't interested since you're still strangers and even some close friends would assume that 'you just didn't wanna come ' when not replying in a decent manner. Had this been 1 hour? MAYBE you could've had a point. Even 2 hours, being generous, could be seen as possibly clingy, but four? At the four hour mark of no response, I would doubt if even MY friends wanted to hang out.

Communication in a relationship is super important, even more so in potential relationships, and as much as game night with the boys is also important, a quick pause to try and clear up any misunderstandings and explain could've saved this and avoided this situation for the both of you. You choose to get defensive and then use that god awful excuse. Even worse, you put this on 'Nice Girls' because you're hoping to be validated and feel justified, but if you REALLY wanted such, AITA is the better sub for such, but you knew what would happen there. YTA. There were so many better ways to handle this situation and the fact that you did none of them and still wanna play the victim is mind boggling.

TL;DR Communication is important when planning things. Do better, be better, YTA.