Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-5748

Backport YARN-5718 to branch-2

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Patch Available
    • Major
    • Resolution: Unresolved
    • None
    • None
    • None
    • None
    • Incompatible change

    Description

      In YARN-5718, we have identify several unnecessary config to over-write HDFS client behavior in several components of YARN (FSRMStore, TimelineClient, NodeLabelStore, etc.) which cause job failure in some cases (NN HA, etc.) - that's definitely belongs to bug. In YARN-5718, we proposed to remove the config as it shouldn't be supposed to work, which get committed to trunk already as alpha stage has more flexibility for incompatible changes. In branch-2, we want to play a bit more safe and get more discussion.
      Obviously, there are several options here:
      1. Don't fix anything, let bug exist
      2. Fix the bug, but keep the configuration, or mark it deprecated and add some explanation to say this configuration is not supposed to work any more.
      3. Exactly like YARN-5718, fix the bug and remove the unnecessary configuration.
      This ticket is filed for more discussion.

      Attachments

        1. YARN-5748-branch-2.002.patch
          12 kB
          Masatake Iwasaki
        2. YARN-5748-branch-2.001.patch
          12 kB
          Masatake Iwasaki

        Issue Links

          Activity

            People

              iwasakims Masatake Iwasaki
              junping_du Junping Du
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated: