Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-5238 Improve NN operation throughput
  3. HDFS-5239

Allow FSNamesystem lock fairness to be configurable

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.0-alpha, 3.0.0-alpha1
    • 0.23.10, 2.3.0
    • namenode
    • None
    • Reviewed

    Description

      The fairness of the FSNamesystem#fsLock is hardcoded to true. Using an unfair lock provides a negligible increase to throughput. However this is due to bottlenecks elsewhere in the system. In combination with other changes, such as RPC layer and audit logging, preliminary tests show up to a 5X improvement for a read heavy workload.

      Attachments

        1. HDFS-5239.patch
          3 kB
          Daryn Sharp
        2. HADOOP-5239.branach-23.patch
          3 kB
          Daryn Sharp

        Issue Links

          Activity

            People

              daryn Daryn Sharp
              daryn Daryn Sharp
              Votes:
              0 Vote for this issue
              Watchers:
              13 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: