Details

    • Type: New Feature
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.3.0
    • Fix Version/s: 1.3.0
    • Component/s: Sinks+Sources
    • Labels:

      Description

      Motivation:
      Some production usecase(s) requires event(log) to be indexed and searched. There are workarounds (e.g. store the log in HDFS and run MapReduce job to create an index) but lack of near real-time indexing and search latency are concerns for searching the log records.

      Design:
      ElasticSearch supports RESTful style API to publish events for indexing.

      There is an existing flumeelastic sink [1] in github but it does not support batching of events for indexing.

      [1] https://github.com/Aconex/elasticflume

        Attachments

        1. FLUME-1371.patch
          61 kB
          Cameron Gandevia

          Issue Links

            Activity

              People

              • Assignee:
                gnoremac Cameron Gandevia
                Reporter:
                mubarakseyed Mubarak Seyed
              • Votes:
                1 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: