Uploaded image for project: 'Crunch (Retired)'
  1. Crunch (Retired)
  2. CRUNCH-490

Prefer mapreduce.framework.name for determining which version of MR is running

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 0.11.0
    • 0.12.0
    • Core
    • None

    Description

      We use a different poll interval for the MRExecutor depending on whether or not we're running in local mode, and we determine whether or not we're running in local mode based on the value of the mapreduce.jobtracker.address property in the configuration. However, a more reliable way to do this is by checking the mapreduce.framework.name, esp. for yarn-based jobs that will not have a meaningful value for the jobtracker property.

      Attachments

        1. CRUNCH-490.patch
          1 kB
          Josh Wills

        Activity

          People

            jwills Josh Wills
            jwills Josh Wills
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment