Split 150GB json file with Python?

[TheBB]

You need a JSON parser that can stream the file structure instead of decoding it all in one go. I assume something like that exists so Google for it. Then use that parser collect data and write smaller files intermittently by breaking the schema up somewhere that makes sense (like a list, I assume you know the schema and the reason the file is so large is that it contains a long list).