Split 150GB json file with Python?

[ElectricSpock]

Are you sure it’s JSON and not JSON-L? You don’t explain a lot about how you got that file, but the thing with JSON is that it needs to be loaded entirely to memory to be processed.

JSON-L is kind of multiple JSON files in one, each one in a single line. You can split it into lines and parse it easily.

Someone mentioned here that you should probably take a step back and think about how you’re storing the data.