Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-6490

Hooks to map reduce task output (OutputCommitter) for Hive Storage Handlers

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Minor
    • Resolution: Unresolved
    • 0.10.0
    • 0.10.1
    • Configuration

    Description

      If user sets the "mapred.output.committer.class" property in jobConf via the storage handler implementation , then he/she can override the nulloutputcommitter to get hooks for commitJob , cleanupJob etc.

      Hence we can make use of the outputcommitter class in hive :
      http://hadoop.apache.org/docs/r2.2.0/api/org/apache/hadoop/mapred/OutputCommitter.html

      commitJob provides a place to do job context tasks if needed by the storage handler

      Attachments

        1. HIVE-6490-branch-0.10.patch
          5 kB
          Yash Datta

        Activity

          People

            Unassigned Unassigned
            saucam Yash Datta
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: