[NUTCH-1220] Upgrade Solr deps

• Type: Task
• Status: Closed
• Priority: Minor
• Resolution: Resolved
• Component/s: build, indexer
• Assignee: Markus Jelsma
• Reporter: Markus Jelsma
• Created: 14/Dec/11 10:42
• Updated: 28/Jan/21 14:03
• Resolved: 01/Oct/19 12:45

Description

SlfJ4 needs to be part of upgrade to Solr 3.5 but that breaks something else. Likely Hadoop has a different Slf4J version?

Exception in thread "main" java.lang.NoSuchMethodError: org.slf4j.spi.LocationAwareLogger.log(Lorg/slf4j/Marker;Ljava/lang/String;ILjava/lang/String;[Ljava/lang/Object;Ljava/lang/Throwable;)V
        at org.apache.commons.logging.impl.SLF4JLocationAwareLog.debug(SLF4JLocationAwareLog.java:133)
        at org.apache.hadoop.security.Groups.getUserToGroupsMappingService(Groups.java:136)
        at org.apache.hadoop.security.UserGroupInformation.initialize(UserGroupInformation.java:180)
        at org.apache.hadoop.security.UserGroupInformation.ensureInitialized(UserGroupInformation.java:159)
        at org.apache.hadoop.security.UserGroupInformation.isSecurityEnabled(UserGroupInformation.java:216)
        at org.apache.hadoop.security.UserGroupInformation.getLoginUser(UserGroupInformation.java:409)
        at org.apache.hadoop.security.UserGroupInformation.getCurrentUser(UserGroupInformation.java:395)
        at org.apache.hadoop.fs.FileSystem$Cache$Key.<init>(FileSystem.java:1418)
        at org.apache.hadoop.fs.FileSystem$Cache.get(FileSystem.java:1319)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:226)
        at org.apache.hadoop.fs.FileSystem.get(FileSystem.java:109)
        at org.apache.hadoop.mapred.JobConf.getWorkingDirectory(JobConf.java:544)
        at org.apache.hadoop.mapred.FileInputFormat.addInputPath(FileInputFormat.java:339)
        at org.apache.nutch.util.domain.DomainStatistics.run(DomainStatistics.java:108)
        at org.apache.hadoop.util.ToolRunner.run(ToolRunner.java:65)
        at org.apache.nutch.util.domain.DomainStatistics.main(DomainStatistics.java:215)
        at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method)
        at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39)
        at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25)
        at java.lang.reflect.Method.invoke(Method.java:597)
        at org.apache.hadoop.util.RunJar.main(RunJar.java:156)

Issue Links

• depends upon: NUTCH-1633 slf4j is provided by hadoop and should not be included in the job file.
• is superceded by: NUTCH-2600 Refactoring indexer-solr