Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-11111

Allow output of Elasticsearch error responses from REST API based PutElasticsearch processors

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 2.0.0-M1, 1.22.0
    • None
    • None

    Description

      PutElasticsearchJson and PutElasticsearchRecord both allow the logging of the Elasticseach Bulk API responses when there are errors (or not_found status if enabled in the processor properties).

      They also (optionally) output the FlowFile documents/Records that caused the errors/not_found status (by matching the index of the error/not_found responses to the input FlowFile(s)/Record(s)).

      However, viewing the NiFi logs is not always easy in some environments and matching the NiFi FlowFile/Record to the Elasticsearch error response can be difficult.

      Adding the ability to output the Elasticsearch error/not_found responses (as enabled within the NiFi processors) would help NiFi users debug issues with data sent to Elasticsearch.

      Attachments

        Issue Links

          Activity

            People

              Chris S Chris Sampson
              Chris S Chris Sampson
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 3.5h
                  3.5h