Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6714

FsShell 'hadoop fs -text' does not support compression codecs

    Details

    • Type: Improvement
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.22.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Currently, 'hadoop fs -text myfile' looks at the first few magic bytes of a file to determine whether it is gzip compressed or a sequence file. This means 'fs -text' cannot properly decode .deflate or .bz2 files (or other codecs specified via configuration).

      It should be fairly straightforward to add support for other codecs by checking the file extension against the CompressionCodecFactory to retrieve an appropriate Codec.

        Attachments

        1. hadoop-6714-20-1.patch
          1 kB
          Eli Collins
        2. HADOOP-6714.patch
          1 kB
          Patrick Angeles

          Activity

            People

            • Assignee:
              patrickangeles Patrick Angeles
              Reporter:
              patrickangeles Patrick Angeles
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: