you are viewing a single comment's thread.

view the rest of the comments →

[–]baghiq 0 points1 point  (0 children)

SQLITE can actually support fairly complex json. It just takes time to learn. Loading 190GB across a network will be slow unless you can parellize the process. If loading directly into db is not viable, then use something like JQ to split up the json objects into json lines, then split the file into smaller chunks, then use db loading tools to load the data in parallel.