Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5238 Improve NN operation throughput
  3. HDFS-5239

Allow FSNamesystem lock fairness to be configurable

    XMLWordPrintableJSON

    Details

    • Type: Sub-task
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
    • Fix Version/s: 0.23.10, 2.3.0
    • Component/s: namenode
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      The fairness of the FSNamesystem#fsLock is hardcoded to true. Using an unfair lock provides a negligible increase to throughput. However this is due to bottlenecks elsewhere in the system. In combination with other changes, such as RPC layer and audit logging, preliminary tests show up to a 5X improvement for a read heavy workload.

        Attachments

        1. HADOOP-5239.branach-23.patch
          3 kB
          Daryn Sharp
        2. HDFS-5239.patch
          3 kB
          Daryn Sharp

          Issue Links

            Activity

              People

              • Assignee:
                daryn Daryn Sharp
                Reporter:
                daryn Daryn Sharp
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: