Logging hadoop map process

Viewed 160

I'm working on hadoop. I have 100k Zip files and processing files using mapreduce But now I have a task that I need to keep track some logs.

1.Zip files processed 2. Zip files need to be process 3. Status of the process, Like error or success

I'm doing it by using the following method

catch (Exception Ex)
        {
            System.out.println("Killing task ");
            runningJob.killTask((TaskAttemptID)context.getTaskAttemptID(), true);

        }

Like this . But now i need to store it in a a common place

How can i do it

I though of storing it in Hbsae. Ideas are welcome Kindly help me

2 Answers
Related