How to pick yesterday date in spark sql for a date in Unix Date Format? Example : Select * from **** where date in (DateinUnixFormat)
Please help.
How to pick yesterday date in spark sql for a date in Unix Date Format? Example : Select * from **** where date in (DateinUnixFormat)
Please help.
Let's say you have a table called test, you can add another column called yesterday that holds yesterday's date as unix timestamp through:
spark.sql("select *,to_unix_timestamp(date_add(current_date(), -1),'yyyy-MM-dd') as yesterday from test")
Final output:
+------------+----------+
| test| yesterday|
+------------+----------+
| test|1662588000|
+------------+----------+
Good luck!