Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-6868

Skip checksum is broke; are we double-checksumming by default?

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: 0.94.0, 0.94.1
    • Fix Version/s: 0.94.2
    • Component/s: HFile, wal
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The HFile contains checksums for decrease the iops, so when Hbase read HFile , that dont't need to read the checksum from meta file of HDFS. But HLog file of Hbase don't contain the checksum, so when HBase read the HLog, that must read checksum from meta file of HDFS. We could add setSkipChecksum per file to hdfs or we could write checksums into WAL if this skip checksum facility is enabled

        Attachments

        1. 6868-0.96-idea.txt
          2 kB
          Lars Hofhansl
        2. 6868-0.96-v2.txt
          1 kB
          Lars Hofhansl
        3. 6868-0.96-v3.txt
          2 kB
          Lars Hofhansl
        4. 6868-0.94.txt
          1 kB
          Lars Hofhansl

          Issue Links

            Activity

              People

              • Assignee:
                larsh Lars Hofhansl
                Reporter:
                liulei.cn LiuLei
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: