I have a JSON file that is 130GB with an unknown structure that I want to eventually be able to parse and query. The challenge is that the structure of the object changes several times throughout the file (I think the file is a dump of database tables), so I don't think I can simply chunk it and process it piecemeal since I don't know where one object starts and the other begins.
The file is a public price transparency from a large insurer (here is the link). The insurers fought tooth and nail to keep this data private so I expect they had little incentive to make it easily usable.
Any suggestions on a strategy I can use will be greatly appreciated.