Details

    • Type: New Feature New Feature
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.3.0
    • Fix Version/s: v1.3.0
    • Component/s: Sinks+Sources
    • Labels:

      Description

      Motivation:
      Some production usecase(s) requires event(log) to be indexed and searched. There are workarounds (e.g. store the log in HDFS and run MapReduce job to create an index) but lack of near real-time indexing and search latency are concerns for searching the log records.

      Design:
      ElasticSearch supports RESTful style API to publish events for indexing.

      There is an existing flumeelastic sink [1] in github but it does not support batching of events for indexing.

      [1] https://github.com/Aconex/elasticflume

      1. FLUME-1371.patch
        61 kB
        Cameron Gandevia

        Issue Links

          Activity

            People

            • Assignee:
              Cameron Gandevia
              Reporter:
              Mubarak Seyed
            • Votes:
              1 Vote for this issue
              Watchers:
              10 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development