Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-2836

Provide option to fail jobs when submitted to non-existent pools.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.1.0
    • Component/s: contrib/fair-share
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      In some environments, it might be desirable to explicitly specify the fair scheduler pools and to explicitly fail jobs that are not submitted to any of the pools.

      Current behavior of the fair scheduler is to submit jobs to a default pool if a pool name isn't specified or to create a pool with the new name if the pool name doesn't already exist. There should be a configuration option for the fair scheduler that causes it to noisily fail the job if it's submitted to a pool that isn't pre-specified or if the specified pool doesn't exist.

      1. MAPREDUCE-2836_0.20_security_rev2.patch
        14 kB
        Ahmed Radwan
      2. MAPREDUCE-2836_0.20_security_rev3.patch
        14 kB
        Ahmed Radwan
      3. MAPREDUCE-2836_0.20_security.patch
        13 kB
        Ahmed Radwan
      4. MAPREDUCE-2836_rev2.patch
        11 kB
        Ahmed Radwan
      5. MAPREDUCE-2836_rev3.patch
        11 kB
        Ahmed Radwan
      6. MAPREDUCE-2836_rev4.patch
        12 kB
        Ahmed Radwan
      7. MAPREDUCE-2836_rev5.patch
        14 kB
        Ahmed Radwan
      8. MAPREDUCE-2836_trunk_rev2.patch
        14 kB
        Ahmed Radwan
      9. MAPREDUCE-2836_trunk_rev3.patch
        15 kB
        Ahmed Radwan
      10. MAPREDUCE-2836_trunk_rev4.patch
        15 kB
        Ahmed Radwan
      11. MAPREDUCE-2836_trunk.patch
        14 kB
        Ahmed Radwan
      12. MAPREDUCE-2836.patch
        8 kB
        Ahmed Radwan

        Activity

        Matt Foley made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Arun C Murthy made changes -
        Fix Version/s 0.24.0 [ 12317654 ]
        Todd Lipcon made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Fix Version/s 0.20.206.0 [ 12317960 ]
        Fix Version/s 0.24.0 [ 12317654 ]
        Resolution Fixed [ 1 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_trunk_rev4.patch [ 12494863 ]
        Attachment MAPREDUCE-2836_0.20_security_rev3.patch [ 12494864 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_trunk_rev3.patch [ 12494589 ]
        Attachment MAPREDUCE-2836_0.20_security_rev2.patch [ 12494590 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_0.20_security.patch [ 12494511 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_trunk_rev2.patch [ 12494202 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_trunk.patch [ 12493951 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_rev5.patch [ 12493755 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_rev4.patch [ 12492698 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_rev3.patch [ 12492505 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836_rev2.patch [ 12491862 ]
        Ahmed Radwan made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Ahmed Radwan made changes -
        Attachment MAPREDUCE-2836.patch [ 12491605 ]
        Ahmed Radwan made changes -
        Assignee Ahmed Radwan [ ahmed.radwan ]
        Jeff Bean made changes -
        Field Original Value New Value
        Priority Major [ 3 ] Minor [ 4 ]
        Jeff Bean created issue -

          People

          • Assignee:
            Ahmed Radwan
            Reporter:
            Jeff Bean
          • Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development