Uploaded image for project: 'Apache NiFi'
  1. Apache NiFi
  2. NIFI-4838

Make GetMongo support multiple commits and give some progress indication

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Won't Fix
    • None
    • None
    • None
    • None

    Description

      It shouldn't wait until the end to do a commit() call because the effect is that GetMongo looks like it has hung to a user who is pulling a very large data set.

      It should also have an option for running a count query to get the current approximate count of documents that would match the query and append an attribute that indicates where a flowfile stands in the total result count. Ex:

      query.progress.point.start = 2500

      query.progress.point.end = 5000

      query.count.estimate = 17,568,231

      Attachments

        Activity

          People

            mike.thomsen Mike Thomsen
            mike.thomsen Mike Thomsen
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 10m
                10m