Hadoop jar command - override hadoop jar with custom jar

Viewed 9

I am trying to submit my jar with hadoop jar command and this is what I realize. The version of hadoop I have is using guava-11.0.jar and I require guava-20.0.jar or newer to run my code.

When I submit jar using hadoop jar command it's taking guava-11.0.jar and complains java.lang.NoSuchMethodError as certain methods doesn't exists in 11 version.

How to tell hadoop to use the guava-20.0.jar from my fat jar I am submitting.

I tried setting following environment variables as well. but same error.

export HADOOP_USER_CLASSPATH_FIRST=true
0 Answers
Related