We are consuming around 50TB data by making multiple calls to the rest services from a different source and the same data we are planning to index into Apache solr using Apache spark at same time.
If someone can suggest whether Apache Spark is right choice or not for this activity and if yes then which module of spark we should integrate?
Any reference, guidance or suggestions are welcomed.