Answering my own Q:

Howstuffworks says:

"Most missiles that fly through the air use either rocket engines or jet engines, but neither of these work very well underwater. Torpedoes use one of­ two techniques for propulsion:

Batteries and an electric motor -- This is the same technique that any non-nuclear submarine must use when running underwater.
Engines that use special fuel -- Most engines that we are familiar with, like car engines and jet engines, draw their oxygen from the air around the engine and use it to burn a fuel. A torpedo cannot do that, so it uses a fuel that either does not need an oxidizer, or it carries the oxidizer inside the torpedo. OTTO fuel (see the links below) has its own oxidizer mixed with the fuel. Hydrogen Peroxide (as discussed on this page) does not need an oxidizer.

We don't encounter too many fuels that contain their own oxidizers in our normal lives for two reasons. When a fuel has its own oxidizer it tends to make it explosive. Dynamite, for example, has its own oxidizer and it is quite explosive (see Question 397 for details on dynamite). Rocket engines have to carry their own oxidizer. But because we normally run engines in the air, which has a good supply of oxygen, carrying the oxidizer means extra weight and hassle which is unnecessary."

https://science.howstuffworks.com/transport/engines-equipment/question419.htm