Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6153

RAgzip: multiple map tasks for a large gzipped file

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Minor
    • Resolution: Duplicate
    • 0.21.0
    • None
    • io, native
    • None

    • It requires zlib 1.2.2.4 or higher. (We tested on zlib 1.2.3)

    Description

      It support to enable multiple map tasks for one large gzipped file.

      Attachments

        1. HADOOP-6153.patch
          40 kB
          Daehyun Kim
        2. hadoop-6153.txt
          41 kB
          Todd Lipcon

        Issue Links

          is duplicated by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-491 RAgzip: multiple map tasks for a large gzipped file

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          is related to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-7909 Implement a generic splittable signature-based compression format

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Open
          relates to

          New Feature - A new feature of the product, which has yet to be developed. HADOOP-7076 Splittable Gzip

          • Major - Major loss of function.
          • Resolved

          Activity

            People

              ohyun49kdh Daehyun Kim
              ohyun49kdh Daehyun Kim
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: