I'm trying to ingest data from jupyter notebook into a data lake (hdfs), the both hdfs and jupyter are in kubernetes deployed, i want to know how can i save a data after data cleaning, I tried this :
data.to_csv("hdfs:hdfs-namenode.default.svc.cluster.local/data/NameOfFile")
But it's not working !
NB: Namespace : default svc : hdfs-namenode pod name: hdfs-namenode-0