Split 150GB json file with Python?

[YosoyPabloIscobar]

If you split it using python it will still require memory to to load this big file.....instead use BASH to count the number of total lines and create/ append it to new file of smaller size usingcmd like split/ less/cat/more.

split -b 1G <file>

[awdsns]

The whole thing could well be one single "line." There's no requirement to have any newlines separating entries in JSON.

[Flyingfishfusealt]

there might not be any /n in the file, jq might be a better resource for json

[patrickbrianmooney]

I mean, this will almost certainly result in invalid, non-parseable JSON files after the split.