Uploaded image for project: 'Samza'
  1. Samza
  2. SAMZA-1434

Fix issues found in Hadoop

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      Fix the following bugs found when running Samza on hadoop:

      • Hdfs allows output partitions to be 0 (empty folder)
      • Add null check for the changelog topic generation
      • Call getStreamSpec() instead of using streamSpec member in StreamEdge. This is due to getStreamSpec will do more transformation.
      • Bound the auto-generated intermediate topic partition by a certain count (256).

        Attachments

          Activity

            People

            • Assignee:
              xinyu Xinyu Liu
              Reporter:
              xinyu Xinyu Liu

              Dates

              • Created:
                Updated:
                Resolved:

                Issue deployment