Data Bricks Community Edition Cannot Read Uploaded Table (Was Working Before)

user_4331516 0
Viewed 571

So when I was trying to work with some ideas on DataBricks Community Edition today, I suddenly find out the python pandas can no longer read a existing uploaded table. The directories were working before, but none of my previously uploaded tables can be read any more, all return in "File ... Not Exist". Anyone know what we can do?

Command used:

import pandas as pd
df = pd.read_csv('/dbfs/FileStore/tables/iris.csv')

File is definitely there, this also affects all my other previously uploaded files.

DBFS

enter image description here

Any suggestion would be appreciated

databricks-community-edition pandas databricks python
1 Answers

How did you load the csv? from blob? if from blob you probably have not mounted.

Can you try read as spark? If you can't read then the file is corrupt. If you can, try apply sdf.to.pandas().

sdf = spark.read.csv('/FileStore/tables/iris.csv', header="true", inferSchema="true")
user_89869750
Related