Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-10961

Use of deprecated Google Guava (v17) Stopwatch constructor in Hadoop FileInputFormat causes an exception

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Duplicate
    • Affects Version/s: 2.4.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      With Google Guava 17 the Stopwatch() constructor is marked as deprecated. The use of the constructor in org.apache.hadoop.mapreduce.lib.input.FileInputFormat (Line 369) causes an exception

      Exception in thread "main" java.lang.IllegalAccessError: tried to access method com.google.common.base.Stopwatch.<init>()V from class org.apache.hadoop.mapreduce.lib.input.FileInputFormat
      at org.apache.hadoop.mapreduce.lib.input.FileInputFormat.getSplits(FileInputFormat.java:369)
      at org.apache.hadoop.mapreduce.JobSubmitter.writeNewSplits(JobSubmitter.java:493)
      at org.apache.hadoop.mapreduce.JobSubmitter.writeSplits(JobSubmitter.java:510)
      at org.apache.hadoop.mapreduce.JobSubmitter.submitJobInternal(JobSubmitter.java:394)
      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1285)
      at org.apache.hadoop.mapreduce.Job$10.run(Job.java:1282)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1556)
      at org.apache.hadoop.mapreduce.Job.submit(Job.java:1282)
      at org.apache.hadoop.mapreduce.Job.waitForCompletion(Job.java:1303)

        Issue Links

          Activity

          Hide
          stevel@apache.org Steve Loughran added a comment -

          one of the perennial "google drops things from Guava problems" that can only be addressed by moving up Guava, here to v15+

          Show
          stevel@apache.org Steve Loughran added a comment - one of the perennial "google drops things from Guava problems" that can only be addressed by moving up Guava, here to v15+
          Hide
          nydi Daniel Nydegger added a comment -

          Yes thats right. However, it is a well known problem with library dependency overall, you know...
          Google Guava is wide used library, a version update has to be generally proved. By Google, it is not so smart to change things upwards, that causes exceptions downwards.
          It would be nice if the the hadoop team will move to the newest Google Guava library for the next release.

          Show
          nydi Daniel Nydegger added a comment - Yes thats right. However, it is a well known problem with library dependency overall, you know... Google Guava is wide used library, a version update has to be generally proved. By Google, it is not so smart to change things upwards, that causes exceptions downwards. It would be nice if the the hadoop team will move to the newest Google Guava library for the next release.
          Hide
          stevel@apache.org Steve Loughran added a comment -

          duplicate of HADOOP-11032, which contains the patch

          Show
          stevel@apache.org Steve Loughran added a comment - duplicate of HADOOP-11032 , which contains the patch

            People

            • Assignee:
              Unassigned
              Reporter:
              nydi Daniel Nydegger
            • Votes:
              0 Vote for this issue
              Watchers:
              4 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development