Uploaded image for project: 'Beam'
  1. Beam
  2. BEAM-13209

DynamoDBIO silently drops unprocessed items

    XMLWordPrintableJSON

Details

    Description

      `batchWriteItem` might fail partially and return unprocessed items. Such partial failures are not handled and result in a data loss.

      If hitting DynamoDB at scale it's rather likely to run into this.

      Attachments

        Issue Links

          is blocked by

          Bug - A problem which impairs or prevents the functions of the product. BEAM-13009 DynamoDBIO misses writing items if `withDeduplicateKeys` is not set

          • P1 - Critical bug: data loss, total loss of function, or loss of testing signal due to test failures or flakiness
          • Triage Needed
          links to

          Web Link GitHub Pull Request #15964

          Web Link GitHub Pull Request #16239

          Activity

            People

              mosche Moritz Mack
              mosche Moritz Mack
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 1h 50m
                  1h 50m