How to get the frequency of a specific value in each row of pandas dataframe

user_682661 0
Viewed 1143

I have this pandas DataFrame:

df = pd.DataFrame(
    data=[
        ['yes', 'no', np.nan],
        ['no', 'yes', 'no'],
        [np.nan, 'yes', 'yes'],
        ['no', 'no', 'no']
    ],
    index=pd.Index(['xyz_1', 'xyz_2', 'xyz_3', 'xyz_4'], name='ID'),
    columns=['class1', 'class2', 'class3']
)

print(df)
Out:

    ID         class1  class2   class3
xyz_1          yes     no       NaN    
xyz_2          no      yes      no
xyz_3          NaN     yes      yes
xyz_4          no      no       no

I want to get the frequency of the 'yes' and 'no' in the class columns per row and have a new data frame which looks like:

    ID         yes     no       nan
xyz_1          1       1        1
xyz_2          1       2        0
xyz_3          2       0        1
xyz_4          0       3        0

I looked at this question, but I don't want the sum but the counts.

Any ideas?

pandas python
3 Answers

Use pd.get_dummies, but set dummy_na to True:

pd.get_dummies(
    df, prefix='', prefix_sep='', dummy_na=True
 ).groupby(level=0, axis=1).sum()  # Sum the *counts* for each column.

       nan  no  yes
ID                 
xyz_1    1   1    1
xyz_2    0   2    1
xyz_3    1   0    2
xyz_4    0   3    0
user_49090870

You may check melt + crosstab

newdf=df.melt('ID')

pd.crosstab(newdf.ID,newdf.value.fillna('NaN'))
Out[8]: 
value  NaN  no  yes
ID                 
xyz_1    1   1    1
xyz_2    0   2    1
xyz_3    1   0    2
xyz_4    0   3    0
user_79645270

Using pd.get_dummies

df = df.set_index('ID') # Do this line only if 'ID' is not index

df2 = pd.get_dummies(df, dummy_na=True)

df['no']  = df2[df2.columns[df2.columns.str.endswith('no')]].sum(1)
df['yes'] = df2[df2.columns[df2.columns.str.endswith('yes')]].sum(1)
df['nan'] = df2[df2.columns[df2.columns.str.endswith('nan')]].sum(1)
user_25356110
Related