Uploaded image for project: 'Hadoop YARN'
  1. Hadoop YARN
  2. YARN-9768

RM Renew Delegation token thread should timeout and retry

    XMLWordPrintableJSON

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 3.3.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Delegation token renewer thread in RM (DelegationTokenRenewer.java) renews HDFS tokens received to check for validity and expiration time.

      This call is made to an underlying HDFS NN or Router Node (which has exact APIs as HDFS NN). If one of the nodes is bad and the renew call is stuck the thread remains stuck indefinitely. The thread should ideally timeout the renewToken and retry from the client's perspective.

       

        Attachments

        1. YARN-9768.001.patch
          3 kB
          Manikandan R
        2. YARN-9768.002.patch
          18 kB
          Manikandan R
        3. YARN-9768.003.patch
          16 kB
          Manikandan R
        4. YARN-9768.004.patch
          21 kB
          Manikandan R
        5. YARN-9768.005.patch
          21 kB
          Manikandan R
        6. YARN-9768.006.patch
          20 kB
          Manikandan R
        7. YARN-9768.007.patch
          22 kB
          Manikandan R
        8. YARN-9768.008.patch
          22 kB
          Manikandan R
        9. YARN-9768.009.patch
          22 kB
          Manikandan R
        10. YARN-9768.010.patch
          22 kB
          Manikandan R

          Issue Links

            Activity

              People

              • Assignee:
                manirajv06@gmail.com Manikandan R
                Reporter:
                crh CR Hota
              • Votes:
                0 Vote for this issue
                Watchers:
                13 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: