Uploaded image for project: 'Hadoop Map/Reduce'
  1. Hadoop Map/Reduce
  2. MAPREDUCE-6761

Regression when handling providers - invalid configuration ServiceConfiguration causes Cluster initialization failure

Log workAgile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersCreate sub-taskConvert to sub-taskMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Reviewed

    Description

      When a rogue org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider defines a provider that is not on classpath, then the initialization is failed with the following exception:

      java.util.ServiceConfigurationError: org.apache.hadoop.mapreduce.protocol.ClientProtocolProvider: Provider org.apache.hadoop.mapred.YarnClientProtocolProvider not found
      at java.util.ServiceLoader.fail(ServiceLoader.java:239)
      at java.util.ServiceLoader.access$300(ServiceLoader.java:185)
      at java.util.ServiceLoader$LazyIterator.nextService(ServiceLoader.java:372)
      at java.util.ServiceLoader$LazyIterator.next(ServiceLoader.java:404)
      at java.util.ServiceLoader$1.next(ServiceLoader.java:480)
      at org.apache.hadoop.mapreduce.Cluster.initProviderList(Cluster.java:84)
      at org.apache.hadoop.mapreduce.Cluster.initialize(Cluster.java:114)
      at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:108)
      at org.apache.hadoop.mapreduce.Cluster.<init>(Cluster.java:101)
      at org.apache.hadoop.mapred.JobClient.init(JobClient.java:477)
      at org.apache.hadoop.mapred.JobClient.<init>(JobClient.java:455)

      This regression is caused by MAPREDUCE-6473

      Attachments

        1. MAPREDUCE-6761.5.patch
          6 kB
          Peter Vary
        2. MAPREDUCE-6761.4.patch
          6 kB
          Peter Vary
        3. MAPREDUCE-6761.3.patch
          13 kB
          Peter Vary
        4. MAPREDUCE-6761.2.patch
          6 kB
          Peter Vary
        5. MAPREDUCE-6761.patch
          2 kB
          Peter Vary

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            pvary Peter Vary Assign to me
            pvary Peter Vary
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment