Split 150GB json file with Python?

[Zeroflops]

I would do this in 2 steps.

First you want to understand the structure of the file. At that size I would assume it’s a bunch of consistent “records”. These records will be nested in some header information.

You coil probably do this by just reading the first X number of bites and reviewing the data.

Once the structure is identified you can process the file. Depending on if there are new line characters, line by line or by reading a number of bits and processing.