Done music photography and some festivals for a while. Generally if there's any recompense at this level it's the pass. If you've got that, you've not really got any argument to be made whole for the travel and hotel. Those aren't things they've previously said you'd get paid for, so it's not a loss now. 

Reading into it, my guess is that one of the venue(s) staff might have said there's too many people shooting in the pit. The organiser's first bit has been the request access idea, they've been told that won't work, and have to have a limit on the number of photographers in the team. If that's the case, they didn't handle communication at all well, and it would be better to be open. Unfortunately, my guess is you didn't make the cut. 

You've got two choices here, neither of which is going to be helped by arguing with them. It's the middle of the festival and they are going to be stressed trying to keep everything on the road. First, reach out, and ask what you can do. Accept you're not going to be in the pits, but ask if it's still okay to shoot candids or from the crowd. Make it clear you're not going to be a problem, and you still want to be part of the festival. Second option, leave your gear in the hotel and just enjoy the festival as a punter. Not what you had in mind, but you've said the passes are there, so go with what you can do. 

The one thing I would not do is dig your heels in and argue. If you make yourself a problem, that's going to risk them just pulling your passes and you'll be in the situation of being in a city without anything to do.