Issue while using bigquery with pyspark-Not working with Dataframe transformation operations such as df.filter : action works such as df.show

Two ways I tried :

1. Working - Create as temptable using createorreplacetempview() , and apply transformation using spark sql , it's working .

2. Not working - Creating as data frame and apply dataframe api for transformation . the below issue snippet has the exception details .

Thanks in advance .