Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-11388

Add an OSS RecoverableWriter

    XMLWordPrintableJSON

Details

    Description

      OSS offers persistence only after uploads or multi-part uploads complete.  In order to make streaming uses OSS as sink, we should implement a Recoverable writer. This writer will snapshot and store multi-part upload information and recover from those information when failure occurs

      Attachments

        Issue Links

          relates to

          Sub-task - The sub-task of the issue FLINK-9752 Add an S3 RecoverableWriter

          • Major - Major loss of function.
          • Closed

          New Feature - A new feature of the product, which has yet to be developed. FLINK-9749 Rework Bucketing Sink

          • Major - Major loss of function.
          • Closed
          links to

          Web Link GitHub Pull Request #7798

          Web Link GitHub Pull Request #19072

          Web Link GitHub Pull Request #19181

          Web Link GitHub Pull Request #19292

          There are no Sub-Tasks for this issue.

          Activity

            People

              wujinhu wujinhu
              wujinhu wujinhu
              Votes:
              1 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Time Tracking

                  Estimated:
                  Original Estimate - Not Specified
                  Not Specified
                  Remaining:
                  Remaining Estimate - 0h
                  0h
                  Logged:
                  Time Spent - 10m
                  10m