Uploaded image for project: 'Crunch'
  1. Crunch
  2. CRUNCH-490

Prefer mapreduce.framework.name for determining which version of MR is running

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.11.0
    • Fix Version/s: 0.12.0
    • Component/s: Core
    • Labels:
      None

      Description

      We use a different poll interval for the MRExecutor depending on whether or not we're running in local mode, and we determine whether or not we're running in local mode based on the value of the mapreduce.jobtracker.address property in the configuration. However, a more reliable way to do this is by checking the mapreduce.framework.name, esp. for yarn-based jobs that will not have a meaningful value for the jobtracker property.

        Attachments

          Activity

            People

            • Assignee:
              jwills Josh Wills
              Reporter:
              jwills Josh Wills
            • Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: