Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-2063

Command to pull corrupted files

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Closed
    • Blocker
    • Resolution: Fixed
    • 0.14.1
    • 0.17.0
    • fs
    • None
    • Added a new option -ignoreCrc to fs -get, or equivalently, fs -copyToLocal, such that crc checksum will be ignored for the command. The use of this option is to download the corrupted files.

    Description

      Before 0.14, dfs -get didn't perform checksum checking.
      Users were able to download the corrupted files to see if they want to delete them.

      After 0.14, dfs -get also does the checksumming.

      Requesting a command for no-checksum-get command.

      Attachments

        1. 2063_20080219.patch
          17 kB
          Tsz-wo Sze
        2. 2063_20080220.patch
          24 kB
          Tsz-wo Sze
        3. 2063_20080221.patch
          27 kB
          Tsz-wo Sze
        4. 2063_20080222.patch
          25 kB
          Tsz-wo Sze

        Activity

          People

            szetszwo Tsz-wo Sze
            knoguchi Koji Noguchi
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: