i am developing a Data Pipeline that will uses PySpark to ingest the data. One of the requirements of the customer is run a function using the PyCrypto to Encrypt the data.
I have a DataFrame where the data will be Encrypted, then i need do a for to access each row and encrypt the data.
To do this access is best use For, Map or any other?
Please give-me examples.