Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6434

Add support for PartialFileOutputCommiter when checkpointing is an option during preemption

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None

    Description

      Finish up some renaming work related to the annotation @Preemptable (it should be @Checkpointable now) and help in the splitting of patch in MAPREDUCE-5269 that is too large for being reviewed or accepted by Jenkins CI scripts.

      Attachments

        1. MAPREDUCE-6434.006.patch
          14 kB
          Augusto Souza
        2. MAPREDUCE-6434.005.patch
          13 kB
          Augusto Souza
        3. MAPREDUCE-6434.004.patch
          8 kB
          Augusto Souza
        4. MAPREDUCE-6434.003.patch
          31 kB
          Augusto Souza
        5. MAPREDUCE-6434.002.patch
          46 kB
          Augusto Souza
        6. MAPREDUCE-6434.001.patch
          31 kB
          Augusto Souza

        Issue Links

          is depended upon by

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-5269 Preemption of Reducer (and Shuffle) via checkpointing

          • Major - Major loss of function.
          • Patch Available
          is related to

          Sub-task - The sub-task of the issue MAPREDUCE-5176 Preemptable annotations (to support preemption in MR)

          • Major - Major loss of function.
          • Closed
          relates to

          Improvement - An improvement or enhancement to an existing feature or task. MAPREDUCE-6444 Add a checkpointable version of shuffle and reduce context supported by a checkpoint manager which uses the HDFS

          • Major - Major loss of function.
          • Patch Available

          Activity

            People

              augustorsouza Augusto Souza
              augustorsouza Augusto Souza
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated: