Can I read rows from in-between in pandas df, like I have dataframe with 10 Million records and I want to read the records between 2 Million to 3 Million records. I know I can use skiprows but that won't solve my problem.
Solution:
start_point = 2000000, number_of_records_to_be_loaded = 1000000 #2M-1M
pd.read_csv(file,skiprows=start_point,nrows=number_of_records)
You can pass a callable function to skiprows so that pd.read_csv knows where to start and stop (this can be useful if you want a more complicated row selecting operation). For your question, this works:
pd.read_csv(filepath, skiprows=lambda x: x not in range(2000000,3000000))
Edit: as you suggested, the following also works:
pd.read_csv(file, skiprows=2000000, nrows=1000000)