Uploaded image for project: 'Apache Apex Malhar'
  1. Apache Apex Malhar
  2. APEXMALHAR-1687

AbstractBlockReader threshold breaks the idempotency

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 2.1.0
    • adapters other
    • None

    Description

      The block reader in library currently breaks the idempotency by queueing block-metadata in memory.
      Will remove the threshold property and the queue internal to BlockReader.

      It should be the responsibility of the upstream to slow down if BlockReader is slowing down the pipeline.

      Attachments

        Activity

          People

            csingh Chandni Singh
            csingh Chandni Singh
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: