Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6581 Write to single replica in memory
  3. HDFS-7090

Use unbuffered writes when persisting in-memory replicas

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.6.0
    • Fix Version/s: 2.6.0
    • Component/s: datanode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      The LazyWriter thread just uses FileUtils.copyFile to copy block files to persistent storage. It would be better to use unbuffered writes to avoid churning page cache.

        Attachments

        1. HDFS-7090.4.patch
          14 kB
          Xiaoyu Yao
        2. HDFS-7090.3.patch
          14 kB
          Xiaoyu Yao
        3. HDFS-7090.2.patch
          13 kB
          Xiaoyu Yao
        4. HDFS-7090.1.patch
          14 kB
          Xiaoyu Yao
        5. HDFS-7090.0.patch
          6 kB
          Xiaoyu Yao

          Issue Links

            Activity

              People

              • Assignee:
                xyao Xiaoyu Yao
                Reporter:
                arp Arpit Agarwal
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: