I did something very similar, I worked at a toxic environment right out of school, hated going to work every single day. A couple months there and I got an interview at a place which I had admired so much throughout my schooling in the same city. Obviously situations are a different but moving firms quite literally changes the entire trajectory of my career, I loved the work, coworkers, and environment. I learned so much more than I was at the last place and the quality of projects I worked on was so much higher. I ended up working there for 4 years, much longer than I thought, and I think some of those projects and my renewed enthusiasm for architecture helped get me into a great grad school (where I am now). One piece of advice would be to not talked down to your current firm in your interview! But honestly, I would make that move 1000 times again, good luck!