Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-10713

Throttle FsNameSystem lock warnings

    XMLWordPrintableJSON

    Details

    • Hadoop Flags:
      Reviewed

      Description

      The NameNode logs a message if the FSNamesystem write lock is held by a thread for over 1 second. These messages can be throttled to at one most one per x minutes to avoid potentially filling up NN logs. We can also log the number of suppressed notices since the last log message.

        Attachments

        1. HDFS-10713.000.patch
          8 kB
          Hanisha Koneru
        2. HDFS-10713.001.patch
          9 kB
          Hanisha Koneru
        3. HDFS-10713.002.patch
          9 kB
          Hanisha Koneru
        4. HDFS-10713.003.patch
          15 kB
          Hanisha Koneru
        5. HDFS-10713.004.patch
          15 kB
          Hanisha Koneru
        6. HDFS-10713.005.patch
          16 kB
          Hanisha Koneru
        7. HDFS-10713.006.patch
          15 kB
          Hanisha Koneru
        8. HDFS-10713.007.patch
          19 kB
          Hanisha Koneru
        9. HDFS-10713.008.patch
          19 kB
          Hanisha Koneru
        10. HDFS-10713.009.patch
          19 kB
          Hanisha Koneru
        11. HDFS-10713.010.patch
          19 kB
          Hanisha Koneru
        12. HDFS-10713.011.patch
          19 kB
          Hanisha Koneru
        13. HDFS-10713.012.patch
          18 kB
          Hanisha Koneru
        14. HDFS-10713.branch-2.000.patch
          18 kB
          Hanisha Koneru

          Issue Links

          is depended upon by

          Test - A new unit, integration or system test. HDFS-10829 Improve Testing for NN Lock Logging

          • Major - Major loss of function.
          • Open
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-9145 Tracking methods that hold FSNamesystemLock for too long

          • Major - Major loss of function.
          • Resolved
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. HDFS-10475 Adding metrics for long FSNamesystem read and write locks

          • Major - Major loss of function.
          • Open

            Activity

              People

              • Assignee:
                hanishakoneru Hanisha Koneru
                Reporter:
                arp Arpit Agarwal
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: