Hadoop Common
  1. Hadoop Common
  2. HADOOP-8042

When copying a file out of HDFS, modifying it, and uploading it back into HDFS, the put fails due to a CRC mismatch

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Critical Critical
    • Resolution: Fixed
    • Affects Version/s: 0.23.1, 0.24.0
    • Fix Version/s: 0.23.2
    • Component/s: fs
    • Labels:
      None
    • Environment:

      KR at Yahoo

      Description

      Performing an hdfs -get on a file, modifying the file, and using hdfs -put to place the file back into HDFS results in a checksum error. It seems that the problem is a .crc file being generated locally from the -get command even though the -crc option was NOT specified.

      1. HADOOP-2048.patch
        13 kB
        Daryn Sharp
      2. HDFS-2777.patch
        9 kB
        Daryn Sharp

        Issue Links

          Activity

          Kevin J. Price created issue -
          Mahadev konar made changes -
          Field Original Value New Value
          Fix Version/s 0.23.1 [ 12318885 ]
          Priority Major [ 3 ] Critical [ 2 ]
          Kihwal Lee made changes -
          Assignee Daryn Sharp [ daryn ]
          Daryn Sharp made changes -
          Link This issue is blocked by HADOOP-7998 [ HADOOP-7998 ]
          Daryn Sharp made changes -
          Link This issue is blocked by HADOOP-8001 [ HADOOP-8001 ]
          Daryn Sharp made changes -
          Link This issue is blocked by HADOOP-8013 [ HADOOP-8013 ]
          Daryn Sharp made changes -
          Attachment HDFS-2777.patch [ 12513886 ]
          Daryn Sharp made changes -
          Status Open [ 1 ] Patch Available [ 10002 ]
          Affects Version/s 0.24.0 [ 12317653 ]
          Target Version/s 0.24.0, 0.23.1 [ 12317653, 12318885 ]
          Fix Version/s 0.23.1 [ 12318885 ]
          Uma Maheswara Rao G made changes -
          Affects Version/s 0.24.0 [ 12317653 ]
          Affects Version/s 0.23.1 [ 12318885 ]
          Target Version/s 0.23.1, 0.24.0 [ 12318885, 12317653 ]
          Component/s fs [ 12310689 ]
          Component/s hdfs client [ 12312928 ]
          Project Hadoop HDFS [ 12310942 ] Hadoop Common [ 12310240 ]
          Key HDFS-2777 HADOOP-8042
          Affects Version/s 0.24.0 [ 12317652 ]
          Affects Version/s 0.23.1 [ 12318884 ]
          Daryn Sharp made changes -
          Attachment HADOOP-2048.patch [ 12513962 ]
          Robert Joseph Evans made changes -
          Status Patch Available [ 10002 ] Resolved [ 5 ]
          Fix Version/s 0.23.2 [ 12319855 ]
          Resolution Fixed [ 1 ]

            People

            • Assignee:
              Daryn Sharp
              Reporter:
              Kevin J. Price
            • Votes:
              0 Vote for this issue
              Watchers:
              11 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development