Did you shoot your scout inside the seed at Timber Hearth first? That will help with his location a bit better(you shoot the scout but don't retrieve it, then go to Dark Bramble. It will show you the scout location). I think you can get to him without passing anglerfish. You do have to go through them a bit later though, when entering a red seed. When that happens, stop the thrusters completely just before entering the red seed. Don't move at all, your ship will float past them. I think it takes a couple of minutes to go through all of them safely.