Pandas Data Frame Filtering Multiple Conditions

You could do:

mask = ~df[['year', 'month']].apply(tuple, 1).isin([(1990, 7), (1990, 8), (1991, 1)])
print(df[mask])

Output

   year  month  data1
2  1990      9   2500
3  1990      9   1500
5  1991      2    350
6  1991      3    350
7  1991      7    450

Even faster (roughly 3x than the elegant version of @DaniMesejo applying tuple). But also it relies on the knowledge that months are bounded to (well below) 100, so less generalizable:

mask = ~(df.year*100 + df.month).isin({199007, 199008, 199101})
df[mask]

# out:
   year  month  data1
2  1990      9   2500
3  1990      9   1500
5  1991      2    350
6  1991      3    350
7  1991      7    450

How come this is 3x faster than the tuples solution? (Tricks for speed):

1. All vectorized operations and no apply.
2. No string operations, all ints.
3. Using .isin() with a set as argument (not a list).

Let us try merge

out = df.drop(df.reset_index().merge(pd.DataFrame({'year':[1990,1990,1991],'month':[7,8,1]}))['index'])
   year  month  data1
2  1990      9   2500
3  1990      9   1500
5  1991      2    350
6  1991      3    350
7  1991      7    450

And small improvement

out = df.merge(pd.DataFrame({'year':[1990,1990,1991],'month':[7,8,1]}),indicator=True,how='left').loc[lambda x : x['_merge']=='left_only']
   year  month  data1     _merge
2  1990      9   2500  left_only
3  1990      9   1500  left_only
5  1991      2    350  left_only
6  1991      3    350  left_only
7  1991      7    450  left_only

Based on my test this should be fast than apply tuple method ~

[EDIT] just iterate over your df and get all indexes to delete:

dates_to_avoid = [(1990, 7), (1990, 8), (1991, 1)])
index_to_delete = [row.index for row in df.itertuples() if (row.year, row.month) in dates_to_avoid]
   

Then:

df = df.loc[~df.index.isin(index_to_delete)]

Here the keyword ~ will avoid all values from the list.

You can add a value for yyyymm and then use this to remove the data you want.

df['yyyymm'] = df['year'].astype(str) + df['month'].astype(str).zfill(2)
df = df.loc[(df.yyyymm != '199007') & (df.yyyymm != '199008') & (df.yyyymm != '199101')]

Set the year and month as indices, filter on the indices with isin and a callable and reset the index:

(
    df.set_index(["year", "month"])
    .loc[lambda x: ~x.index.isin([(1990, 7), (1990, 8), (1991, 1)])]
    .reset_index()
)


year    month   data1
0   1990    9   2500
1   1990    9   1500
2   1991    2   350
3   1991    3   350
4   1991    7   450

Alternatively, you can use the drop function to drop the rows you are not interested in, and reset the index:

(df.set_index(["year", "month"], drop = False)
 .drop([(1990, 7), (1990, 8), (1991, 1)])
 .reset_index(drop = True)
  )

You can use apply function

def filter(row):
  # Add other conditions and just return row accordingly
  if ((row.year != 1990) | (row.month != 7)):
    return True
  return False

mask = df.apply(filter,axis=1)
df[mask]