Uploaded image for project: 'Apache Storm'
  1. Apache Storm
  2. STORM-2489

Overlap and data loss on WindowedBolt based on Duration

Attach filesAttach ScreenshotVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.0.2
    • 2.0.0, 1.1.1, 1.2.0
    • storm-core
    • None
    • windows 10, eclipse, jdk1.7
    • Important

    Description

      The attachment is my test script, one of my test results is:
      ```
      expired=1...55
      get=56...4024
      new=56...4024
      Recived=3969,RecivedTotal=3969
      expired=56...4020
      get=4021...8191
      new=4025...8191
      Recived=4171,RecivedTotal=8140
      SendTotal=12175
      expired=4021...8188
      get=8189...12175
      new=8192...12175
      Recived=3987,RecivedTotal=12127
      ```
      This test result shows that some tuples appear in the expired list directly, we lost these data if we just use get() to get tuples, this is the first bug.
      The second: the tuples of get() has overlap, the getNew() seems alright.

      The problem not happen definitely, may need to try several times.

      Actually, I'm newbie about storm, so I'm not sure this is a bug indeed, or, I use it in wrong way?

      Attachments

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            arunmahadevan Arun Mahadevan
            wangkui wangkui
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Time Tracking

                Estimated:
                Original Estimate - Not Specified
                Not Specified
                Remaining:
                Remaining Estimate - 0h
                0h
                Logged:
                Time Spent - 3h
                3h

                Slack

                  Issue deployment