Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-2751

Datanode drops OS cache behind reads even for short reads

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 0.23.0, 2.0.0-alpha
    • 0.23.1, 1.1.0
    • datanode
    • None
    • Reviewed

    Description

      HDFS-2465 has some code which attempts to disable the "drop cache behind reads" functionality when the reads are <256KB (eg HBase random access). But this check was missing in the close() function, so it always drops cache behind reads regardless of the size of the read. This hurts HBase random read performance when this patch is enabled.

      Attachments

        1. hdfs-2751.txt
          0.8 kB
          Todd Lipcon
        2. hdfs-2751.txt
          0.8 kB
          Todd Lipcon
        3. HDFS-2751.branch-1.patch
          0.7 kB
          Brandon Li

        Issue Links

          Activity

            People

              tlipcon Todd Lipcon
              tlipcon Todd Lipcon
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: