Pandas Drop Duplicates To CSV

user_4526288 0
Viewed 661

I have the following code:

import pandas as pd

df = pd.read_csv('/home/test/cities.csv')

dupes = df.drop_duplicates(subset=['latitude', 'longitude'], keep=False)

dupes.to_csv('/home/test/results.csv')

I want to drop all records with duplicate latitude and longitude information.

The output CSV file contains all the non-duplicated records.

Any suggestions on how to extract all the duplicate records?

pandas csv python-3.x
1 Answers

duplicated

The sister method to drop_duplicates

these_are_the_dupes = df[df.duplicated(subset=['latitude', 'longitude'], keep=False)]
user_23366540
Related