Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-2913

BlockMergeTask Doesn't Honor Job Configuration Properties when used directly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.8.1
    • 0.9.0
    • Query Processor
    • None
    • Reviewed

    Description

      BlockMergeTask has a main() and when used directly (instead of say partition concatenate feature), the -jobconf arguments are not honored. This is not something most people directly use.

      Usage:
      BlockMergeTask -input <colon seperated input paths> -outputDir outputDir [-jobconf k1=v1 [-jobconf k2=v2] ...]

      To reproduce:
      Run BlockMergeTask with say -jobconf mapred.job.name=test and launched job will have a different name.

      Attachments

        1. HIVE-2913_1.patch
          0.8 kB
          Thiruvel Thirumoolan
        2. blockmerge.sh
          1 kB
          Thiruvel Thirumoolan
        3. ASF.LICENSE.NOT.GRANTED--HIVE-2913.D2547.1.patch
          0.8 kB
          Phabricator

        Activity

          People

            thiruvel Thiruvel Thirumoolan
            thiruvel Thiruvel Thirumoolan
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: