Does Spark Supports With Clause?

Viewed 15392

I have table employee_1 in spark with attributes id and name(with data), and another table employee_2 with same attributes, i want to load the data by increasing the id values with +1

My With Clause shown below:

WITH EXP AS (SELECT  ALIASNAME.ID+1 ID, ALIASNAME.NAME NAME FROM employee_1 ALIASNAME)
INSERT INTO TABLE employee_2 SELECT * FROM EXP; 

Steps of execution:

I have a file(with data) in HDFS location.

  1. Creating RDD based on hdfs location.
  2. RDD to Hive temp table
  3. from temp table to Hive Target (employee_2).

when i am running with test program from backend its succeeding. but data is not loading. employee_2 is empty.

Note: If you run the above with clause in Hive it will succeed and data will load. But in spark it won't in 1.6 ?

1 Answers
Related