Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-204

Revive number of files listed metrics

    Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.21.0
    • Fix Version/s: 0.21.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When namenode becomes unresponsive by HADOOP-4693 (large filelist calls), metrics has been helpful in finding out the cause.
      When gc time hikes, "FileListed" metrics also hiked.

      In 0.18, after we fixed "FileListed" metrics so that it shows number of operations instead of number of files listed (HADOOP-3683), I stopped seeing this relationship graph.

      Can we bring back "NumbverOfFilesListed" metrics?

      1. HDFS-204-2.patch
        5 kB
        Suresh Srinivas
      2. HDFS-204-2.patch
        5 kB
        Suresh Srinivas
      3. HDFS-204.patch
        4 kB
        Jitendra Nath Pandey
      4. HDFS-204.patch
        5 kB
        Jitendra Nath Pandey
      5. getFileNum-yahoo20.patch
        5 kB
        Hairong Kuang

        Activity

        Koji Noguchi created issue -
        Owen O'Malley made changes -
        Field Original Value New Value
        Project Hadoop Common [ 12310240 ] HDFS [ 12310942 ]
        Key HADOOP-4694 HDFS-204
        Affects Version/s 0.18.0 [ 12312972 ]
        Component/s dfs [ 12310710 ]
        Component/s metrics [ 12310971 ]
        Jitendra Nath Pandey made changes -
        Attachment HDFS-204.patch [ 12411574 ]
        Jitendra Nath Pandey made changes -
        Attachment HDFS-204.patch [ 12411675 ]
        Suresh Srinivas made changes -
        Attachment HDFS-204-2.patch [ 12411678 ]
        Suresh Srinivas made changes -
        Attachment HDFS-204-2.patch [ 12411679 ]
        Jitendra Nath Pandey made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Affects Version/s 0.21.0 [ 12314046 ]
        Jitendra Nath Pandey made changes -
        Assignee Jitendra Nath Pandey [ jnp ]
        Tsz Wo Nicholas Sze made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.21.0 [ 12314046 ]
        Resolution Fixed [ 1 ]
        Tsz Wo Nicholas Sze made changes -
        Component/s name-node [ 12312926 ]
        Hairong Kuang made changes -
        Attachment getFileNum-yahoo20.patch [ 12437576 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Jitendra Nath Pandey
            Reporter:
            Koji Noguchi
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development