Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-6714

FsShell 'hadoop fs -text' does not support compression codecs

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 0.22.0
    • None
    • None
    • Reviewed

    Description

      Currently, 'hadoop fs -text myfile' looks at the first few magic bytes of a file to determine whether it is gzip compressed or a sequence file. This means 'fs -text' cannot properly decode .deflate or .bz2 files (or other codecs specified via configuration).

      It should be fairly straightforward to add support for other codecs by checking the file extension against the CompressionCodecFactory to retrieve an appropriate Codec.

      Attachments

        1. hadoop-6714-20-1.patch
          1 kB
          Eli Collins
        2. HADOOP-6714.patch
          1 kB
          Patrick Angeles

        Activity

          People

            patrickangeles Patrick Angeles
            patrickangeles Patrick Angeles
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: