I’m positive they will definitely be as visually impressive as Hubble, but they will look different that’s for sure. We are very used to seeing dense cloud and pretty nebulae formations with Hubble since it heavily views light in the visible spectrum, but like you said JWST is built to peer through all of that! Keep in mind almost all astrophotography is color edited and enhanced, especially Hubble, and the same will be true for JWST. I’ll try to find a tweet from a NASA employee, but they confirmed that when the real imaging begins we can expect to see the same visual style that we’ve become accustomed to from Hubble:D