Elasticsearch 7.17.4 hdfs repository plugin with Hadoop 2.10.2

Viewed 4

We have a multi-nodes Elasticsearch 7.17.4 with a Hadoop 2.10.2 in our offline environment. We want to setup the snapshot repository using the "repository-hdfs-7.17.4.zip" plugin (https://www.elastic.co/guide/en/elasticsearch/plugins/7.17/repository-hdfs.html). But this plugin is packed with some hadoop-3.x.x jar. As the version of our Hadoop is 2.10.2, how should we modify this plugin to make it work?

Should we just pack the below jar into the zip?

  • hadoop-annotations-2.10.2.jar
  • hadoop-auth-2.10.2.jar
  • hadoop-client-2.10.2.jar
  • hadoop-hdfs-2.10.2.jar
  • hadoop-hdfs-client-2.10.2.jar

Do we need to remove the below jar from the zip?

  • hadoop-hdfs-3.3.1.jar
  • hadoop-client-runtime-3.3.1.jar

For the guava, it looks different from the previous version (7.15.2) as well, any modification needed?

  • (7.15.2) : guava-11.0.2.jar
  • (7.17.4) : guava-27.1-jre.jar

Many thanks.

0 Answers
Related