I am fitting a Random Cut Forest model on AWS SageMaker to a dataset using " rcf.fit(rcf.record_set(data[['Variable 1','Variable 2']].values.reshape(-1, 1)))" , but getting the below error :
An error occurred (EntityTooLarge) when calling the PutObject operation: Your proposed upload exceeds the maximum allowed size.
The size of the ndarray is 239393964
Works well for a sample of the data, but not working for the entire data set (total records : 400M)
How can I fix this?