Pandas: How to concatenate dataframes with different columns?

user_6330511 0
Viewed 17154

I tried to find the answer in the official Pandas documentation, but found it more confusing than helpful. Basically I have two dataframes with overlapping, but not identical column lists:

df1:
   A   B
0  22  34
1  78  42

df2:
   B   C
0  76  29
1  11  67

I want to merge/concatenate/append them so that the result is

df3:
   A   B   C
0  22  34  nan
1  78  42  nan
2  nan 76  29
3  nan 11  67

Should be fairly simple, but I've tried several intuitive approaches and always got errors. Can anybody help me?

pandas dataframe python
3 Answers

Both @vaishali and @scott-boston solution work. Prefer the merge function as it allow more flexibility on your result with the how parameter. Howerver concat can achieve better performance if few columns are involved

To optimize @scott-boston answer, you can also use the internal concat parameter igonore_index that automatically resize the index without calling another function the code would be like :

pd.concat([df1,df2],ignore_index=True)

Output

      A   B     C
0  22.0  34   NaN
1  78.0  42   NaN
2   NaN  76  11.0
3   NaN  11  67.0

Python (version 3.8.5) | pandas(version 1.1.3)

user_76268130
Related