Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-9485

TableOutputCommitter should implement recovery if we don't want jobs to start from 0 on RM restart

    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      HBase extends OutputCommitter which turns recovery off. Meaning all completed maps are lost on RM restart and job starts from scratch. FileOutputCommitter implements recovery so we should look at that to see what is potentially needed for recovery.

      Attachments

        1. 9485-0.94.txt
          0.6 kB
          Ted Yu
        2. 9485-v2.txt
          0.6 kB
          Ted Yu

        Activity

          People

            yuzhihong@gmail.com Ted Yu
            yuzhihong@gmail.com Ted Yu
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: