Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-7178

FileSystem should have an option to control the .crc file creations at Local.

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0
    • 0.23.0
    • fs
    • None
    • Reviewed

    Description

      When we copy the files from DFS to local, it is creating the .crc files in local filesystem for the verification of checksum. When user dont want to do any check sum verifications, this files will not be useful.

      Command line already has an option ignoreCrc, to control this.
      So, we should have the similar option on FileSystem also..... like fs.ignoreCrc().
      This should set the setVerifyChecksum to false and also should select the non CheckSumFileSystem as local fs.

      Attachments

        1. HADOOP-7178_COMMON.patch
          4 kB
          Uma Maheswara Rao G
        2. HADOOP-7178_HDFS.patch
          3 kB
          Uma Maheswara Rao G
        3. HADOOP-7178.1.patch
          4 kB
          Uma Maheswara Rao G
        4. HADOOP-7178.2.patch
          3 kB
          Uma Maheswara Rao G
        5. HADOOP-7178.3.patch
          3 kB
          Uma Maheswara Rao G
        6. HADOOP-7178.patch
          4 kB
          Uma Maheswara Rao G

        Issue Links

          Activity

            People

              umamaheswararao Uma Maheswara Rao G
              umamaheswararao Uma Maheswara Rao G
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: