Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-14995

Configuration should be forced to load resources as an option to avoid loss of configuration results lead to data loss

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Open
    • Priority: Critical
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: conf
    • Labels:
      None

      Description

      MapReduce Job, the task initialization by job.xml , but if missing the soft link of "job.xml" file,will do nothing under the quietmode of Configuration.
      Such as map tasks as directly output to HDFS without reduce tasks of job, if map task missing job.xml, it's will run with default behavior, just as IdentityMapper and output to local, and resulting in data loss.

        Attachments

        1. data_loss.png
          276 kB
          DENG FEI
        2. HADOOP-14995-trunk-001.patch
          4 kB
          DENG FEI
        3. job_detail.png
          256 kB
          DENG FEI
        4. log.png
          579 kB
          DENG FEI
        5. normal_task.png
          234 kB
          DENG FEI

        Issue Links

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              Deng FEI DENG FEI

              Dates

              • Created:
                Updated:

                Issue deployment