Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6581 Write to single replica in memory
  3. HDFS-6934

Move checksum computation off the hot path when writing to RAM disk

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 2.6.0
    • Component/s: datanode, hdfs-client
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      Since local RAM is considered reliable we can avoid writing checksums on the hot path when replicas are being written to a local RAM disk.

      The checksum can be computed by the lazy writer when moving replicas to disk.

        Attachments

        1. h6934_20141003b.patch
          29 kB
          Tsz-wo Sze
        2. h6934_20141005.patch
          50 kB
          Tsz-wo Sze
        3. HDFS-6934.3.patch
          85 kB
          Chris Nauroth
        4. HDFS-6934.4.patch
          118 kB
          Chris Nauroth
        5. HDFS-6934.5.patch
          119 kB
          Chris Nauroth
        6. HDFS-6934-branch-2.6.5.patch
          119 kB
          Chris Nauroth

          Activity

            People

            • Assignee:
              cnauroth Chris Nauroth
              Reporter:
              arp Arpit Agarwal
            • Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: