What are root causes for `__getstate__([]) does not exist` error message

Spark is throwing py4j.Py4JException: Method __getstate__([]) does not exist the error seems to be related to different scenarios including UDFs, pyArrow versions, am facing this error in a totally different scenario where am using sagemaker_pyspark to do batch transformation. I want to understand this error to be able to trace the root cause