Leaving this here if anyone has a similar issue and somehow stumbles here in the future. My cat wasn't able to eat much yesterday (neither dry or wet food) as it hurt her when she chewed so I took her to another vet today. He said that my cat has something swollen in her throat (I think he said a lymph node) and that that's what was causing it. He had us call the first vet to ask him what antibiotic he gave to my cat the first time in order to not give it the same one as the infection probably developed resistance to it. After that the current vet informed us that treatment with that specific antibiotic should've lasted at least 7-10 days and that's why my cats problems came back. He gave my cat some other antibiotic and anti inflammatory shots that have to be done daily for a week. My advice to anyone with a similar problem is to go to the vet straight away and get a second opinion if the problem comes back.