Bigtop
  1. Bigtop
  2. BIGTOP-907

hadoop-mapreduce-historyserver should require hadoop-hdfs

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.6.0
    • Component/s: debian, rpm
    • Labels:
      None

      Description

      This problem is usually not encountered because hadoop-mapreduce-historyserver is usually installed on a host where hadoop-hdfs is also installed.
      The hadoop-mapreduce-historyserver package does not have any dependency (direct or indirect) on hadoop-hdfs. If hadoop-hdfs is not installed, however, the hadoop-mapreduce-historyserver service will fail to start, due to:

      2013-04-04 14:15:25,083 FATAL org.apache.hadoop.mapreduce.v2.hs.JobHistoryServer: Error starting JobHistoryServer
      java.lang.RuntimeException: java.lang.ClassNotFoundException: Class org.apache.hadoop.fs.Hdfs not found
              at org.apache.hadoop.conf.Configuration.getClass(Configuration.java:1571)
              at org.apache.hadoop.fs.AbstractFileSystem.createFileSystem(AbstractFileSystem.java:142)
              at org.apache.hadoop.fs.AbstractFileSystem.get(AbstractFileSystem.java:233)
              at org.apache.hadoop.fs.FileContext$2.run(FileContext.java:321)
              at org.apache.hadoop.fs.FileContext$2.run(FileContext.java:319)
              at java.security.AccessController.doPrivileged(Native Method)
              at javax.security.auth.Subject.doAs(Subject.java:396)
              at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1332)
              at org.apache.hadoop.fs.FileContext.getAbstractFileSystem(FileContext.java:319)
              at org.apache.hadoop.fs.FileContext.getFileContext(FileContext.java:432)
              at org.apache.hadoop.fs.FileContext.getFileContext(FileContext.java:454)
              at org.apache.hadoop.mapreduce.v2.hs.HistoryFileManager.init(HistoryFileManager.java:392)
              at org.apache.hadoop.mapreduce.v2.hs.JobHistory.init(JobHistory.java:87)
      ...
      

      Installing the hadoop-hdfs package solves the problem.

        Activity

        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Resolved Resolved
        22h 44m 1 Roman Shaposhnik 07/Apr/13 00:25
        Resolved Resolved Closed Closed
        76d 24m 1 Roman Shaposhnik 22/Jun/13 00:49
        Closed Closed Resolved Resolved
        468d 10h 44m 1 03/Oct/14 11:34
        Anonymous made changes -
        Status Closed [ 6 ] Resolved [ 5 ]
        Roman Shaposhnik made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        Roman Shaposhnik made changes -
        Status Open [ 1 ] Resolved [ 5 ]
        Resolution Fixed [ 1 ]
        Hide
        Roman Shaposhnik added a comment -

        +1 and committed!

        Show
        Roman Shaposhnik added a comment - +1 and committed!
        Hide
        Peter Linnell added a comment -

        +1

        Show
        Peter Linnell added a comment - +1
        Mark Grover made changes -
        Attachment BIGTOP-907.1.patch [ 12577402 ]
        Hide
        Mark Grover added a comment -

        I admit to not doing a whole lot of testing but the patch seems to be fairly trivial.

        Show
        Mark Grover added a comment - I admit to not doing a whole lot of testing but the patch seems to be fairly trivial.
        Mark Grover made changes -
        Field Original Value New Value
        Assignee Mark Grover [ mgrover ]
        Wing Yew Poon created issue -

          People

          • Assignee:
            Mark Grover
            Reporter:
            Wing Yew Poon
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development