Uploaded image for project: 'Apache Apex Malhar'
  1. Apache Apex Malhar
  2. APEXMALHAR-2314

Improper functioning in partitioning of sequentialFileRead property of FSRecordReader

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • None
    • 3.6.0
    • None
    • None

    Description

      Fix the StreamCodec for FSRecordReader, initially it was hashcode of blockId's mostly always unique.
      Hence unable to satisfy the sequentialFileRead property. Now the StreamCodec is modified to work
      with hashcode of filePath. So all blocks related to a file would be partitioned on same operator.

      Attachments

        Issue Links

          Activity

            People

              deepak-narkhede Deepak Narkhede
              deepak-narkhede Deepak Narkhede
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: