AWS glue pyspark - converting one row from source table to multiple rows in destination

Viewed 167

I have the below requirement

enter image description here

How can I achieve this using pyspark explode function

1 Answers

@Mohammad Murtaza Hashmi In need of your help again.

F.split(F.concat_ws(',',*(x for x in df.columns if x.startswith('daily_qty'))),',')

I am not getting how to modify the above to satisfy the below requirement.

enter image description here

Currently destination table looks like below which is wrong enter image description here

Related