XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Normal
    • Resolution: Later
    • None
    • None

    Description

      With the introduction of the BulkOutputFormat, there may be cases where someone would like to tolerate node failures and have the job complete, but afterwards since we streamed they have to repair or rely on read repair. We don't currently have any way of hinting streams, but a node could take a snapshot before acknowledging the stream session, then remember to send the files in the snapshot to the unavailable nodes when they come back up. This isn't quite ideal since of course the node may have compacted these files, however it's much simpler than any sort of key tracking at this scale.

      Attachments

        1. 4047-wip.txt
          10 kB
          Brandon Williams
        2. 4047-2.0-wip.txt
          12 kB
          Yuki Morishita

        Issue Links

          Activity

            People

              Unassigned Unassigned
              brandon.williams Brandon Williams
              Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: