I have several files with an array inside and I need to concatenate these arrays. The problem is those files are a lot and quite big (around 5mb each, in total more than 100mb).
I tried with PlayJson but I got back a StackOverflow error and I think this is caused by the parsing of the String into the Json Object, so I am looking for another Scala library. Do you have any suggestion?
I don't care too much for this case to marshal the json to an object, I simply need a way to do some simple changes in the JSON structure.
Handle large JSON with Scala
Viewed 886
1 Answers
You can use Circe + Iteratee or any parser that supports streaming, eg. Jawn.
Here is a very good tutorial for Circe + Iteratee.
https://github.com/circe/circe/tree/main/examples/sf-city-lots
Related