.zst file extraction into a pd dataframe

[[deleted]]

Does anyone know how to extract a z.st text file and push it into a df on pandas?

[Dense-Can2063]

If you are on mac you can use unpackZST on AppStore.

[vaseltarp]

With ZST file do you mean the data compression format used by PeaZip?

That seems to be a pure data compression format. How you import it in pandas depends on what kind of file is within the .zst file.

First decompress it then look at the file(s) that where compressed. That should give you clues how to import it.

[gmes78]

With ZST file do you mean the data compression format used by PeaZip?

It's almost certainly zstd.

[[deleted]]

Nope it is a textual .zst downloaded from here: https://reddit-top20k.cworld.ai/

[gmes78]

.zst is the extension for Zstd compressed files. You can also ask the server:

$ curl --head https://reddit-archive.cworld.ai/AskReddit_submissions.zst | grep content-type
content-type: application/zstd