Hive
  1. Hive
  2. HIVE-629

concat files needed for map-reduce jobs also

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.4.0
    • Fix Version/s: 0.4.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed
    • Release Note:
      HIVE-629. Concat files for map-reduce jobs. (Namit Jain via zshao)

      Description

      Currently, hive concatenates files only if the job under consideration is a map-only job.

      I got some requests from some users, where they want this behavior for map-reduce jobs also - it may not be a good idea to turn it on by default.
      But, we should provide an option to the user where the concatenation can happen even for map-reduce jobs.

      1. hive.629.1.patch
        10 kB
        Namit Jain
      2. hive.629.2.patch
        10 kB
        Namit Jain

        Activity

        Namit Jain created issue -
        Namit Jain made changes -
        Field Original Value New Value
        Attachment hive.629.1.patch [ 12413511 ]
        Namit Jain made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Namit Jain made changes -
        Attachment hive.629.2.patch [ 12413587 ]
        Zheng Shao made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Release Note HIVE-629. Concat files for map-reduce jobs. (Namit Jain via zshao)
        Fix Version/s 0.4.0 [ 12313714 ]
        Resolution Fixed [ 1 ]
        Carl Steinbach made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Namit Jain
            Reporter:
            Namit Jain
          • Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development