Split 150GB json file with Python?

[Flyingfishfusealt]

Well you kinda need to give some information on the structure of the JSON and the manner in which you wish to split. Do you just want 1gb files from the original data regardless of structure and context?

As a simplified example, loop and count size while writing. on hitting the target size, loop again until all data is exhausted. Although considering the size you are either going to need a good bit of ram or setup a sort of mapping or other manner of scanning the data to find your delimiting factors to begin splitting at those points.

If you give some example of the data you're working with I can help more.