Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9757

Har metadata cache can grow without limit

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 2.0.4-alpha, 0.23.9, 3.0.0-alpha1
    • Fix Version/s: 0.23.10, 2.1.1-beta
    • Component/s: fs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      MAPREDUCE-2459 added a metadata cache to the har filesystem, but the cache has no upper limits. A long-running process that accesses many har archives will eventually run out of memory due to a har metadata cache that never retires entries.

        Attachments

        1. HADOOP_9757.trunk.patch
          6 kB
          Cristina L. Abad
        2. HADOOP_9757.branch23.patch
          6 kB
          Cristina L. Abad
        3. HADOOP_9757.branch-2.patch
          6 kB
          Cristina L. Abad

          Issue Links

            Activity

              People

              • Assignee:
                cabad Cristina L. Abad
                Reporter:
                jlowe Jason Darrell Lowe
              • Votes:
                0 Vote for this issue
                Watchers:
                8 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: