Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-629

concat files needed for map-reduce jobs also

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      HIVE-629. Concat files for map-reduce jobs. (Namit Jain via zshao)

      Description

      Currently, hive concatenates files only if the job under consideration is a map-only job.

      I got some requests from some users, where they want this behavior for map-reduce jobs also - it may not be a good idea to turn it on by default.
      But, we should provide an option to the user where the concatenation can happen even for map-reduce jobs.

        Attachments

        1. hive.629.1.patch
          10 kB
          Namit Jain
        2. hive.629.2.patch
          10 kB
          Namit Jain

          Activity

            People

            • Assignee:
              namit Namit Jain
              Reporter:
              namit Namit Jain
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: