Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7488

Missing System Output for Misconfiguration in Local Mode Settings

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Open
    • Major
    • Resolution: Unresolved
    • 3.3.6
    • None
    • mapreduce-client
    • None

    Description

      Enabling local mode in mapreduce requires setting the mapreduce.framework.name configuration parameter to local. However, users who are unfamiliar with configuration parameters may struggle to do this correctly. The system currently lacks runtime output indicating whether this configuration has taken effect, leading to confusion and a higher likelihood of misconfiguration.
       
      Expected Behavior:
      If the system fails to activate the LocalJobRunner because the mapreduce.framework.name parameter is not set to local, a warning should be output to notify the user.
       
      How-to-Fix:
      We propose enhancing system observability and diagnosability by adding logging.

      Attachments

        1. original-vs-log-enhanced.md
          2 kB
          LoggingResearch
        2. LocalClientProtocolProviderTest.java
          0.8 kB
          LoggingResearch

        Activity

          People

            Unassigned Unassigned
            loggingresearch LoggingResearch
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated: