Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6653

JobSubmitter with unmanaged MRApplicationMaster

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: applicationmaster, client
    • Labels:
      None

      Description

      Long living DAG applications (pig, hive, etc) may launch many mapreduce jobs. Since we already have to allocate resources for these clients, we could reduce the latency of monitoring AM's, the overall number of network RPC's, the number of containers running on YARN cluster by embedding the MRAppMaster with the submitter.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              jira.shegalov Gera Shegalov
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated: