Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-845

DFS -get and DFS -cat on a zip file generate different output

        Details

        • Type: Bug
        • Status: Closed
        • Priority: Minor
        • Resolution: Fixed
        • Affects Version/s: 0.9.1
        • Fix Version/s: None
        • Component/s: None
        • Labels:
          None

          Description

          dfs -get file.gz localfile.gz and dfs -cat file.gz > /tmp/file.gz generate different output. dfs -get geenreates corect output but dfs -cat does not geenerate the right ouput.

            Issue Links

            duplicates

            Bug - A problem which impairs or prevents the functions of the product. HADOOP-628 hadoop hdfs -cat replaces some characters with question marks.

            • Major - Major loss of function.
            • Closed

              Activity

              Ascending order - Click to sort in descending order
              Hide
              Permalink
              hadoopqa Hadoop QA added a comment -

              -1, because the patch command could not apply the latest attachment (http://issues.apache.org) as a patch to trunk revision r489707. Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.

              Show
              hadoopqa Hadoop QA added a comment - -1, because the patch command could not apply the latest attachment ( http://issues.apache.org ) as a patch to trunk revision r489707. Please note that this message is automatically generated and may represent a problem with the automation system and not the patch.
              Hide
              Permalink
              weilei weilei added a comment -

              Some codes are added to org.apache.hadoop.dfs.DFSShell.java. then we can cat gzip file like others

              Show
              weilei weilei added a comment - Some codes are added to org.apache.hadoop.dfs.DFSShell.java. then we can cat gzip file like others
              Hide
              Permalink
              hairong Hairong Kuang added a comment -

              Hadoop dfs -cat does not handle non-ascii bytes correctly. So it can not cat zipped files correctly. Wendy's patch to HADOOP-628 should also be able to fix this bug.

              Show
              hairong Hairong Kuang added a comment - Hadoop dfs -cat does not handle non-ascii bytes correctly. So it can not cat zipped files correctly. Wendy's patch to HADOOP-628 should also be able to fix this bug.
              Hide
              Permalink
              hairong Hairong Kuang added a comment -

              Weilei's patch seems to implement zcat. You may refer to the method getRecordReader in hadoop.org.apache.mapred.TextInputFormat.java for a general implementation of zcat.

              Show
              hairong Hairong Kuang added a comment - Weilei's patch seems to implement zcat. You may refer to the method getRecordReader in hadoop.org.apache.mapred.TextInputFormat.java for a general implementation of zcat.
              Hide
              Permalink
              hairong Hairong Kuang added a comment -

              It's a duplicate of HADOOP-628.

              Show
              hairong Hairong Kuang added a comment - It's a duplicate of HADOOP-628 .

                People

                • Assignee:
                  Unassigned
                  Reporter:
                  mahadev Mahadev konar
                • Votes:
                  0 Vote for this issue
                  Watchers:
                  0 Start watching this issue

                  Dates

                  • Created:
                    Updated:
                    Resolved:

                    Development