Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-9757

Har metadata cache can grow without limit

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 2.0.4-alpha, 0.23.9, 3.0.0-alpha1
    • 0.23.10, 2.1.1-beta
    • fs
    • None
    • Reviewed

    Description

      MAPREDUCE-2459 added a metadata cache to the har filesystem, but the cache has no upper limits. A long-running process that accesses many har archives will eventually run out of memory due to a har metadata cache that never retires entries.

      Attachments

        1. HADOOP_9757.branch23.patch
          6 kB
          Cristina L. Abad
        2. HADOOP_9757.branch-2.patch
          6 kB
          Cristina L. Abad
        3. HADOOP_9757.trunk.patch
          6 kB
          Cristina L. Abad

        Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-2459 Cache HAR filesystem metadata

          • Major - Major loss of function.
          • Closed

          Activity

            People

              cabad Cristina L. Abad
              jlowe Jason Darrell Lowe
              Votes:
              0 Vote for this issue
              Watchers:
              8 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: