Uploaded image for project: 'Apache Apex Malhar'
  1. Apache Apex Malhar
  2. APEXMALHAR-2272

sequentialFileRead property on FSInputModule not functioning as expected

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 3.6.0
    • None
    • None

    Description

      When there is single large file in the input directory, and we have multiple partitions for BlockReader and sequencialFileRead is set to true.
      Only one BlockReader instance should be active; other BlockReader instances should remain idle.
      This is because sequencialFileRead makes sure that blocks of the file are read serially by same BlockReader instance.

      Observed behavior is all BlockReader instances are reading data which means sequencialFileRead property is not functioning as expected.

      Attachments

        Issue Links

          Activity

            People

              devendra Yogi Devendra
              devendra Yogi Devendra
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: