Question as the title,I am learning sparkSQL,but I can't get a good understanding of the difference between them. Thanks.
Question as the title,I am learning sparkSQL,but I can't get a good understanding of the difference between them. Thanks.
There is no difference between spark.table & spark.read.table function.
Inside of spark.read.table is again calling spark.table function.
Check below code.
spark.table It is available inside package org.apache.spark.sql.SparkSession
package org.apache.spark.sql.SparkSession
def table(tableName: String): DataFrame = {
table(sessionState.sqlParser.parseTableIdentifier(tableName))
}
spark.read.table function is available in package org.apache.spark.sql.DataFrameReader & It is again calling spark.table function.
package org.apache.spark.sql.DataFrameReader
def table(tableName: String): DataFrame = {
assertNoSpecifiedSchema("table")
sparkSession.table(tableName)
}