Databricks Timestamp format - How to find exact format?

user_9599091 0
Viewed 262

When I tried to display the date column from pyspark dataframe through show() and display(dataframe) ,those format of the data columns are different . Now how do we arrive which date format is being there in dataframe ?

Display : 2018-02-15T06:47:19.000+0000

show : 2018-02-15 06:47:19

enter image description here

pyspark databricks apache-spark
1 Answers

Timestamp in dataframe isn't stored as a string - it's stored using internal representation (Long in case of timestamp) that is then converted into text by show or display.

Alex_Ott_186270
Related