How to remove UIMA annotations?

user_456564 0
Viewed 973

I'm using some UIMA annotators in a pipeline. It run tasks like:

  • tokenizer
  • sentence splitter
  • gazetizer
  • My Annotator

The problem is that I don't want to write ALL the annotations (Token, Sentence, SubToken, Time, myAnnotations, etc..) to the disk because the files gets very large quicky.

I want to remove all the annotations and keep only the created by My Annotator.

I'm working with the next libraries:

  1. uimaFIT 2.0.0
  2. ClearTK 1.4.1
  3. Maven

And I'm using a org.apache.uima.fit.pipeline.SimplePipeline with:

SimplePipeline.runPipeline(
    UriCollectionReader.getCollectionReaderFromDirectory(filesDirectory), //directory with text files
    UriToDocumentTextAnnotator.getDescription(),
    StanfordCoreNLPAnnotator.getDescription(),//stanford tokenize, ssplit, pos, lemma, ner, parse, dcoref
    AnalysisEngineFactory.createEngineDescription(//
        XWriter.class, 
        XWriter.PARAM_OUTPUT_DIRECTORY_NAME, outputDirectory,
        XWriter.PARAM_FILE_NAMER_CLASS_NAME, ViewURIFileNamer.class.getName())
);

What I'm trying to do is to use the Standford NLP annotator(from ClearTK) and remove the useless annotation.

How do I do this?

From what I know, you can use the removeFromIndexes(); method from with an Annotation instance.

Do I need to create an UIMA processor and add it to my pipeline?

uima nlp java
3 Answers

I rewrote German Attanasios solution using java 8 and changed it to filter out anything with a different annotationTypePrefix:

public void filterAnnotations(JCas jcas, String annotationTypePrefix) {

    JCasUtil.selectAll(jcas)
            .stream()
            .filter(t -> !t.getType().getName().startsWith(annotationTypePrefix))
            .forEach(TOP::removeFromIndexes);
}
user_28616930
Related