Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-5585

FileSystem statistic counters are too high when JVM reuse is enabled.

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Blocker
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.20.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      When JVM reuse is enabled, the FileSystem.Statistics are not cleared between tasks. That means that the second task gets credit for its own reads and writes as well as the first. The third gets credit for all 3 tasks reads and writes.

        Attachments

        1. h5585.patch
          14 kB
          Owen O'Malley
        2. h5585.patch
          18 kB
          Owen O'Malley
        3. h5585.patch
          17 kB
          Owen O'Malley
        4. h5585.patch
          19 kB
          Owen O'Malley

          Activity

            People

            • Assignee:
              omalley Owen O'Malley
              Reporter:
              omalley Owen O'Malley
            • Votes:
              0 Vote for this issue
              Watchers:
              0 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: