Flume
  1. Flume
  2. FLUME-2206

ElasticSearchSink ttl field modification to mimic Elasticsearch way of specifying TTL

    Details

    • Type: Improvement Improvement
    • Status: Resolved
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: v1.5.0
    • Fix Version/s: v1.5.0
    • Component/s: Sinks+Sources
    • Labels:

      Description

      According to current ElasticSearch documentation of TTL:

      "In case you do not specify a time unit like d (days), m (minutes), h (hours), ms (milliseconds) or w (weeks), milliseconds is used as default unit.
      If no default is set and no _ttl value is given then the document has an infinite _ttl and will not expire."

      Current flume ElasticSearchSink index TTL configuration:

      agent.sinks.myESsink.ttl = <some integer value> and defaults to 5 days.

      It will be good to have a qualifier like "d" / "s" / "m" / "w" / "h" to mimic the TTL configuration in ElasticSearch mapping.

      When user specifies agent.sinks.myESsink.ttl = "3w" index TTL should be set to 3 weeks while agent.sinks.myESsink.ttl = 3 will set the TTL to 3 days.

        Activity

        Hari Shreedharan made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Dib Ghosh made changes -
        Attachment FLUME-2206-0.patch [ 12608096 ]
        Dib Ghosh made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Labels features patch
        Fix Version/s v1.5.0 [ 12324642 ]
        Hari Shreedharan made changes -
        Field Original Value New Value
        Assignee Dib Ghosh [ dib.ghosh ]
        Dib Ghosh created issue -

          People

          • Assignee:
            Dib Ghosh
            Reporter:
            Dib Ghosh
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development