Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-15226 Über-JIRA: S3Guard Phase III: Hadoop 3.2 features
  3. HADOOP-13649

s3guard: implement time-based (TTL) expiry for LocalMetadataStore

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Minor
    • Resolution: Fixed
    • 3.0.0-beta1
    • 3.2.0
    • fs/s3
    • None

    Description

      LocalMetadataStore is primarily a reference implementation for testing. It may be useful in narrow circumstances where the workload can tolerate short-term lack of inter-node consistency: Being in-memory, one JVM/node's LocalMetadataStore will not see another node's changes to the underlying filesystem.

      To put a bound on the time during which this inconsistency may occur, we should implement time-based (a.k.a. Time To Live / TTL) expiration for LocalMetadataStore

      Attachments

        1. HADOOP-13649.003.patch
          19 kB
          Aaron Fabbri
        2. HADOOP-13649.002.patch
          20 kB
          Gabor Bota
        3. HADOOP-13649.001.patch
          20 kB
          Gabor Bota

        Issue Links

          Activity

            People

              gabor.bota Gabor Bota
              fabbri Aaron Fabbri
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: