Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-866

dfs -get should remove existing crc file if -crc is not specified

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.10.0
    • 0.10.1
    • fs
    • None
    • All

    Description

      When we added -crc option to dfs -get (aka dfs -copyToLocal) the absence of this command-line option implies not copying the crc file associated with hdfs file. However, if the checksum file already exists, it will not correspond with the newly copied data file, and opening it would cause checksum failure. The solution is to remove any existing crc file corresponding to the data file if -crc option is not given for -get. Patch forthcoming.

      Attachments

        1. hadoop-get.patch
          0.7 kB
          Milind Barve

        Activity

          People

            milindb Milind Barve
            milindb Milind Barve
            Votes:
            0 Vote for this issue
            Watchers:
            0 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: