I'm working on hadoop. I have 100k Zip files and processing files using mapreduce But now I have a task that I need to keep track some logs.
1.Zip files processed 2. Zip files need to be process 3. Status of the process, Like error or success
I'm doing it by using the following method
catch (Exception Ex)
{
System.out.println("Killing task ");
runningJob.killTask((TaskAttemptID)context.getTaskAttemptID(), true);
}
Like this . But now i need to store it in a a common place
How can i do it
I though of storing it in Hbsae. Ideas are welcome Kindly help me