In Pandas DataFrames or CSV files how to concat / update from multiple data frames or CSV files

Viewed 23

I wrote a python web scrape tool for certain online data and then store data in CSV file.

data looks like

  ** Event  Author  Event_ID  score1        Event_Date       score2  score3**
1     A1     B2      xyz1       3        9/18/2022 10:17       5       8
2     A12    B3      xyz2       1        9/18/2022 10:12       9       2
3     A13    B4      xyz3       3        9/18/2022 10:10       4       5
4     A14    B2      xyz4       5        9/18/2022 10:09       1       0

Problem is my tool can get only 800 rows on each time, so I frequently run the tool and saving output to a new csv file each time. ended up with multiple files. I want to make one CSV file to make some visualization on power bi. but there are a common "Event" between files ("Event_ID" column is unique, however "score1" ,"score2", "score3" may changed)

I would appreciate your support on how to concate and update "score" in one file. Thanks

0 Answers
Related