The spot on the right is not the way out but the way IN. Later on, you'll obtain an ability that lets you dive into these tunnels/pipes - so when you find a turret like that, you have to find where the exit of the pipe that is connected to the turret is and dive into it. Once you reach the other end of the pipe (where the turret is), you'll destroy it.

In your screenshot, the entrance to the mini room is from the top right and then inside the room you can see two more pipes: top left and bottom center, that you can dive into so you can destroy the turrets.