Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-7248

Catch RuntimeException in yarn historyserver

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: jobhistoryserver
    • Labels:
      None

      Description

      When we got exception below the thread in jobhisotry will exit, we should catch runtime exception

      xxx 2019-06-30,17:45:52,386 ERROR org.apache.hadoop.hdfs.server.namenode.ha.ZkConfiguredFailoverProxyProvider: Fail to get initial active Namenode informationjava.lang.RuntimeException: Fail to get active namenode from zookeeper
              at org.apache.hadoop.hdfs.server.namenode.ha.ZkConfiguredFailoverProxyProvider.getActiveNNIndex(ZkConfiguredFailoverProxyProvider.java:149)
              at org.apache.hadoop.hdfs.server.namenode.ha.ZkConfiguredFailoverProxyProvider.performFailover(ZkConfiguredFailoverProxyProvider.java:176)
              at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:159)
              at $Proxy15.getListing(Unknown Source)
              at org.apache.hadoop.hdfs.DFSClient.listPaths(DFSClient.java:1996)
              at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:211)
              at org.apache.hadoop.fs.Hdfs$DirListingIterator.<init>(Hdfs.java:198)
              at org.apache.hadoop.fs.Hdfs$2.<init>(Hdfs.java:180)
              at org.apache.hadoop.fs.Hdfs.listStatusIterator(Hdfs.java:180)
              at org.apache.hadoop.fs.FileContext$21.next(FileContext.java:1445)
              at org.apache.hadoop.fs.FileContext$21.next(FileContext.java:1440)
              at org.apache.hadoop.fs.FSLinkResolver.resolve(FSLinkResolver.java:90)
              at org.apache.hadoop.fs.FileContext.listStatus(FileContext.java:1440)
              at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanDirectory(HistoryFileManager.java:739)
              at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanDirectoryForHistoryFiles(HistoryFileManager.java:752)
              at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanIntermediateDirectory(HistoryFileManager.java:806)
              at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.access$200(HistoryFileManager.java:82)
              at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager$UserLogDir.scanIfNeeded(HistoryFileManager.java:280)
              at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.scanIntermediateDirectory(HistoryFileManager.java:792)
      

        Attachments

        1. YARN-9973.001.patch
          1 kB
          zhoukang

          Issue Links

            Activity

              People

              • Assignee:
                Unassigned
                Reporter:
                cane zhoukang
              • Votes:
                0 Vote for this issue
                Watchers:
                2 Start watching this issue

                Dates

                • Created:
                  Updated: