I have a dataset consisting of 7-8 fields which are of type String, Int & Float.
Am trying to create Schema by Programmatic approach by using this :
val schema = StructType(header.split(",").map(column => StructField(column, StringType, true)))
And Then mapping it to Row type like :
val dataRdd = datafile.filter(x => x!=header).map(x => x.split(",")).map(col => Row(col(0).trim, col(1).toInt, col(2).toFloat, col(3), col(4) ,col(5), col(6), col(7), col(8)))
But after creating DataFrame when i use DF.show() it gives error for the Integer field.
So how to create such schema where we have multiple data type in the dataset