Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-6715

webhdfs wont fail over when it gets java.io.IOException: Namenode is in startup mode

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 2.2.0
    • Fix Version/s: 2.6.0
    • Component/s: ha, webhdfs
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Noticed in our HA testing when we run MR job with webhdfs file system we some times run into

      2014-04-17 05:08:06,346 INFO [AsyncDispatcher event handler] org.apache.hadoop.mapreduce.v2.app.job.impl.TaskAttemptImpl: Diagnostics report from attempt_1397710493213_0001_r_000008_0: Container killed by the ApplicationMaster.
      Container killed on request. Exit code is 143
      Container exited with a non-zero exit code 143
      
      2014-04-17 05:08:10,205 ERROR [CommitterEvent Processor #1] org.apache.hadoop.mapreduce.v2.app.commit.CommitterEventHandler: Could not commit job
      java.io.IOException: Namenode is in startup mode
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method)
      	at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:57)
      	at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45)
      	at java.lang.reflect.Constructor.newInstance(Constructor.java:525)
      
      1. HDFS-6715.000.patch
        7 kB
        Jing Zhao
      2. HDFS-6715.001.patch
        7 kB
        Jing Zhao

        Activity

        Arpit Gupta created issue -
        Allen Wittenauer made changes -
        Field Original Value New Value
        Component/s webhdfs [ 12319200 ]
        Jing Zhao made changes -
        Assignee Jing Zhao [ jingzhao ]
        Jing Zhao made changes -
        Attachment HDFS-6715.000.patch [ 12656992 ]
        Jing Zhao made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jing Zhao made changes -
        Attachment HDFS-6715.001.patch [ 12657055 ]
        Jing Zhao made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Fix Version/s 2.6.0 [ 12327181 ]
        Resolution Fixed [ 1 ]
        Arun C Murthy made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Jing Zhao
            Reporter:
            Arpit Gupta
          • Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development