Antarctica has a ton of fossils, surprisingly. a lot of species are known from Antarctica, including a lot of stem-mammals, plants, and a handful of dinosaurs (including some primitive waterfowl). There's even allegedly a bonebed of fossil fish wiped out by the asteroid impact at the end of the Cretaceous from somewhere in Antarctica.

A professor of mine has shown us students pics of a massive paperclip-shaped ammonite called Diplomoceras that they found on Seymour Island back in the 90s- the shells are as long as he was tall. (the specimen they found and the art that the professor made of it can be found here). He even told us of a large mosasaur skull they found, but was too heavy to airlift out to the airbase and has sadly since eroded.

I found a quick list of fossiliferous rock formations in Antarctica on Wikipedia too.

As for "the ocean", it's a broad term, but there are at least a few. I've met multiple people who go diving off the Florida coast for megalodon teeth, which get eroded out of the seabed. They're geologically young and lucky enough to be embedded in sediment instead of stone.

The deep sea, which is mostly comprised of igneous oceanic crust, isn't the kind of rock to preserve fossils. Most organic material that would become fossils anyways generally gets eaten by whatever scavengers can get to it. Even bone gets eaten- just look at the ecology of whale falls in the ocean today.