I had this code:
curl -o fileName.csv url | xargs hdfs dfs -moveFromLocal $1 /somePath/
When i execute this code, curl put the values from request inside fileName.csv, the file are moved to HDFS. I wanna know if i can, mantain the curl output in memory, send to pipe and just write the values inside HDFS?
Something like this(that works):
curl url | xargs hdfs dfs -put $1 /somePath