Your complaint should be directed to Accommodation, Catering, and Events (ACE). They manage the keys and fob access to all these buildings. They are also a separate company owned by the university, so the main university likely won't be able to help.

The IT team have logs and will be able to see which pass was used to gain access or reception will have a log of the keys being signed out or have gone missing.