I would like to know how to read only certain columns from a parquet file, and selecting column names by a pattern like:
df = spark.read.parquet("/v1/phenotypes/tabular/pheno.parquet").select("xeid","x20002_0_*")
Of course this does not work since the wildcard * is bad syntax.
Thanks in advance