there are two types compress file format for spark. one is parquet, it's very easy to read:
from pyspark.sql import HiveContext
hiveCtx = HiveContext(sc)
hiveCtx.parquetFile(parquetFile)
but for ocr file. I cannot find a good example to show me how to use pyspark to read.