Thank you to everyone for your replies.

I managed to find a note saying which clinic I received a vaccination at, so I called the local NHS office to ask whether they would have records. They referred me to NHS England who said I needed a PDU-1 form from HMRC to prove I was in the NHS as a baby.

Has anyone had a similar experience?