How to extract information from multiple json files using python

Question

I have multiple json files in a folder. I had implemented a way to catch only .json files in this folder. My problem is: I need to extract some information contained in each of those files but it didn't work the way I expected. I need to find a way to get this information and convert all into a pandas dataframe.

The variable jsons_data contains all .json files

jsons_data = json_import(path_to_json)

for index, js in enumerate(jsons_data):
    with open(os.path.join(path_to_json, js)) as json_file:
        data = json.loads(json_file)

print(data)

user_1481986 · Answer

The problem in your code is that on every iteration you override the content of data.

I assume you want to create on big dataframe from all the files in that case you can do -

dataframes = []
for js in jsons_data:
    dataframes.append(pd.read_json(os.path.join(path_to_json, js)))
df = pd.concat(dataframes)

See documentation about read_json - https://pandas.pydata.org/pandas-docs/version/1.3.0rc1/reference/api/pandas.read_json.html

How to extract information from multiple json files using python

1 Answers