XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Normal
    • Resolution: Later
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      With the introduction of the BulkOutputFormat, there may be cases where someone would like to tolerate node failures and have the job complete, but afterwards since we streamed they have to repair or rely on read repair. We don't currently have any way of hinting streams, but a node could take a snapshot before acknowledging the stream session, then remember to send the files in the snapshot to the unavailable nodes when they come back up. This isn't quite ideal since of course the node may have compacted these files, however it's much simpler than any sort of key tracking at this scale.

        Attachments

        1. 4047-2.0-wip.txt
          12 kB
          Yuki Morishita
        2. 4047-wip.txt
          10 kB
          Brandon Williams

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                brandon.williams Brandon Williams
              • Votes:
                0 Vote for this issue
                Watchers:
                10 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: