Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-6581 Write to single replica in memory
  3. HDFS-7090

Use unbuffered writes when persisting in-memory replicas

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.6.0
    • 2.6.0
    • datanode
    • None
    • Reviewed

    Description

      The LazyWriter thread just uses FileUtils.copyFile to copy block files to persistent storage. It would be better to use unbuffered writes to avoid churning page cache.

      Attachments

        1. HDFS-7090.0.patch
          6 kB
          Xiaoyu Yao
        2. HDFS-7090.1.patch
          14 kB
          Xiaoyu Yao
        3. HDFS-7090.2.patch
          13 kB
          Xiaoyu Yao
        4. HDFS-7090.3.patch
          14 kB
          Xiaoyu Yao
        5. HDFS-7090.4.patch
          14 kB
          Xiaoyu Yao

        Issue Links

          is related to

          Sub-task - The sub-task of the issue HDFS-7291 Persist in-memory replicas with appropriate unbuffered copy API on POSIX and Windows

          • Major - Major loss of function.
          • Closed

          Activity

            People

              xyao Xiaoyu Yao
              arp Arpit Agarwal
              Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: