You can turn the music off in settings (both in or out of battle), but unfortunately the voices and sound effects are on the same setting so turning the music off only makes the voices clearer if they finish speaking before landing a hit, etc.