bigdata

271 Questions
Newest Active Unanswered Frequent
Score
View
Card Compact
Upserts on Delta simply duplicates data?
user_60264890
•
1
1
252
data-lakehouse delta-lake bigdata databricks architecture
Spark Repartition creates partition more than 128 MB
user_180876600
•
1
1
408
partition bigdata hdfs pyspark apache-spark
How to create modified date column on Pyspark table?
user_176686670
•
1
1
467
delta-lake bigdata pyspark triggers database
How can I process chunks of data in Spark dataframe
user_157718510
•
2
0
187
data-transform bigdata apache-spark-sql apache-spark scala
Fast/efficient way to extract data from multiple large NetCDF files
user_137303130
•
1
1
735
python-xarray bigdata netcdf python
Spark batch processing on driver
user_140748580
•
2
1
82
bigdata apache-spark-sql apache-spark java
Can some explain what is sc._jvm and sc._jsc in spark? For what purpose these 2 are used in spark?
user_175138420
•
1
1
548
bigdata apache-spark jvm java
How to modify a variable iteratively using data.table?
user_168150730
•
1
2
69
bigdata data.table r function string
Koalas dataframe apply lambda two columns of different type
user_81388580
•
2
0
121
spark-koalas bigdata pyspark pandas python
Multisets in Python
user_177037500
•
3
1
265
bigdata data-structures set algorithm python
Hot Questions