Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15226 Über-JIRA: S3Guard Phase III: Hadoop 3.2 features
  3. HADOOP-13649

s3guard: implement time-based (TTL) expiry for LocalMetadataStore

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-beta1
    • 3.2.0
    • fs/s3
    • None

    Description

      LocalMetadataStore is primarily a reference implementation for testing. It may be useful in narrow circumstances where the workload can tolerate short-term lack of inter-node consistency: Being in-memory, one JVM/node's LocalMetadataStore will not see another node's changes to the underlying filesystem.

      To put a bound on the time during which this inconsistency may occur, we should implement time-based (a.k.a. Time To Live / TTL) expiration for LocalMetadataStore

      Attachments

        1. HADOOP-13649.001.patch
          20 kB
          Gabor Bota
        2. HADOOP-13649.002.patch
          20 kB
          Gabor Bota
        3. HADOOP-13649.003.patch
          19 kB
          Aaron Fabbri

        Issue Links

          is cloned by

          Sub-task - The sub-task of the issue HADOOP-15621 S3Guard: Implement time-based (TTL) expiry for Authoritative Directory Listing

          • Major - Major loss of function.
          • Resolved
          relates to

          Sub-task - The sub-task of the issue HADOOP-15423 Merge fileCache and dirCache into one single cache in LocalMetadataStore

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Activity

            People

              gabor.bota Gabor Bota
              fabbri Aaron Fabbri
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: