I'm using Airflow 2 on Cloud Composer. I have a task that uses SimpleHTTPOperator to Get data from an api.
I want to know if there's an elegant way to store data returns from this task into a GCS Bucket : /data folder in my composer Environement.
I tried using xComs but it doesn't look like a good idea, since there's no purge after dag completion.