OSError: [Errno 22] error when i use pyspark in a large dataset

I am trying to analyse a large dataset (35M records) in a jupyter notebook using the pandas api in pyspark. I read the file and everything and when I try to display the dataset, i get an 'OSError: [Errno 22] Invalid argument' error.

import pyspark
import pyspark.pandas as ps
df = ps.read_csv('file.csv')
df

When I do df.head(), the first five rows are displayed normally. However, when i select let's say the first 15 rows instead of 5, I get the same error. The same when i do other data filterings. Any idea what is going one here?