Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9187

FileUtil.CopyMerge should handle compressed input and output

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • 2.3.0
    • None
    • fs

    Description

      This method, if run on compressed input, results in corrupt output since it just does a byte-by-byte concatenation disregarding compression codecs. It should automatically detect compression codecs from input files and handle them intelligently.
      Additionally, there should be an option to create a compressed output file so that the output can be efficiently stored and sent out to customers (over the network outside the cluster).

      Attachments

        1. HADOOP-9187.2.patch
          11 kB
          Tsuyoshi Ozawa
        2. HADOOP-9187.1.patch
          8 kB
          Tsuyoshi Ozawa

        Activity

          People

            ozawa Tsuyoshi Ozawa
            ranadip Ranadip
            Votes:
            2 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated: