MT: Calculating METEOR Score of two different files

Question

For an Machine Translation evaluation I need to calculate the METEOR score between the translation output file and the reference file.

Is there any official Python package or Github repository for the calculation of the METEOR score you would recommend?
How to calculate the METEOR between the reference file and the output translation file?

user_3933141 · Answer

I found out you have to download METEOR from https://www.cs.cmu.edu/~alavie/METEOR/index.html#Download .

For calculating the METEOR Score you need Java as well.

Run the following command to compare the reference and the test file and to get the METEOR score:

java -Xmx2G -jar meteor-1.5.jar test-file reference-file -l de