Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-9145

Tracking methods that hold FSNamesystemLock for too long

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.8.0, 2.7.4, 3.0.0-alpha1
    • namenode
    • None
    • Reviewed

    Description

      It will be helpful that if we can have a way to track (or at least log a msg) if some operation is holding the FSNamesystem lock for a long time.

      Attachments

        1. HDFS-9145.000.patch
          5 kB
          Mingliang Liu
        2. HDFS-9145.001.patch
          6 kB
          Mingliang Liu
        3. HDFS-9145.002.patch
          6 kB
          Mingliang Liu
        4. HDFS-9145.003.patch
          6 kB
          Mingliang Liu
        5. testlog.txt
          59 kB
          Kihwal Lee

        Issue Links

          breaks

          Bug - A problem which impairs or prevents the functions of the product. HDFS-9467 Fix data race accessing writeLockHeldTimeStamp in FSNamesystem

          • Major - Major loss of function.
          • Resolved
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-8883 NameNode Metrics : Add FSNameSystem lock Queue Length

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-10798 Make the threshold of reporting FSNamesystem lock contention configurable

          • Major - Major loss of function.
          • Resolved
          relates to

          Bug - A problem which impairs or prevents the functions of the product. HDFS-10713 Throttle FsNameSystem lock warnings

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-10475 Adding metrics for long FSNamesystem read and write locks

          • Major - Major loss of function.
          • Open

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-10817 Add Logging for Long-held NN Read Locks

          • Major - Major loss of function.
          • Resolved

          Test - A new unit, integration or system test. HDFS-10829 Improve Testing for NN Lock Logging

          • Major - Major loss of function.
          • Open

          Activity

            People

              liuml07 Mingliang Liu
              jingzhao Jing Zhao
              Votes:
              0 Vote for this issue
              Watchers:
              14 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: