Hadoop Map/Reduce
  1. Hadoop Map/Reduce
  2. MAPREDUCE-3514

JHS failed to start when intermediate done path is in LocalFS

    Details

    • Type: Bug Bug
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0-alpha
    • Fix Version/s: None
    • Component/s: jobhistoryserver, mrv2
    • Labels:
      None
    • Environment:

      Single Node Cluster

      Description

      This is the property I have set for intermediate done directory

      <property>
       <name>mapreduce.jobhistory.intermediate-done-dir</name>
       <value>file:///mnt/history/done_intermediate</value>
      </property>
      

      After setting this property, When I started the JHS, it failed to start, and was throwing following exception

      2011-12-06 12:09:13,650 FATAL org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting JobHistoryServer
      org.apache.hadoop.fs.InvalidPathException: Invalid path name Wrong FS: file://<NN Address>:<NN Port>/mnt/history/done_intermediate, expected: file:///
      	at org.apache.hadoop.fs.AbstractFileSystem.checkPath(AbstractFileSystem.java:361)
      	at org.apache.hadoop.fs.FilterFs.checkPath(FilterFs.java:161)
      	at org.apache.hadoop.fs.FilterFs.getFileStatus(FilterFs.java:115)
      	at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1086)
      	at org.apache.hadoop.fs.FileContext$14.next(FileContext.java:1083)
      	at org.apache.hadoop.fs.FileContext$FSLinkResolver.resolve(FileContext.java:2319)
      	at org.apache.hadoop.fs.FileContext.getFileStatus(FileContext.java:1083)
      	at org.apache.hadoop.fs.FileContext$Util.exists(FileContext.java:1506)
      	at org.apache.hadoop.mapreduce.v2.hs.JobHistory.mkdir(JobHistory.java:232)
      	at org.apache.hadoop.mapreduce.v2.hs.JobHistory.init(JobHistory.java:201)
      	at org.apache.hadoop.yarn.service.CompositeService.init(CompositeService.java:58)
      	at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.init(JobHistoryServer.java:62)
      	at org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer.main(JobHistoryServer.java:77)
      2011-12-06 12:09:13,653 INFO org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: SHUTDOWN_MSG:
      

        Activity

        There are no comments yet on this issue.

          People

          • Assignee:
            Unassigned
            Reporter:
            Bhallamudi Venkata Siva Kamesh
          • Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:

              Development