Uploaded image for project: 'Apache Hudi'
  1. Apache Hudi
  2. HUDI-5731

Fix com.google.common classes still being relocated in Hudi Spark bundle

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Critical
    • Resolution: Fixed
    • 0.12.1
    • 0.14.0
    • None

    Description

      As originally reported in:

      https://github.com/apache/hudi/pull/6240#issuecomment-1420149952

       

      The issue have been that after removal of Guava we still kept following relocations configs in MR/Spark bundles:

      <relocation>
        <pattern>com.google.common.</pattern>
        <shadedPattern>org.apache.hudi.com.google.common.</shadedPattern>
      </relocation> 

      Which in turn meant that all references from any class referencing Guava would be shaded, even though Hudi isn't packaging Guava anymore. This might result in following exception:

      Caused by: java.lang.NoClassDefFoundError: org/apache/hudi/com/google/common/base/Preconditions
      	at org.apache.curator.ensemble.fixed.FixedEnsembleProvider.<init>(FixedEnsembleProvider.java:39)
      	at org.apache.curator.framework.CuratorFrameworkFactory$Builder.connectString(CuratorFrameworkFactory.java:193)
      	at org.apache.kyuubi.ha.client.zookeeper.ZookeeperClientProvider$.buildZookeeperClient(ZookeeperClientProvider.scala:62)
      	at org.apache.kyuubi.ha.client.zookeeper.ZookeeperDiscoveryClient.<init>(ZookeeperDiscoveryClient.scala:65)
      	... 45 more 

      Attachments

        Issue Links

          Activity

            People

              alexey.kudinkin Alexey Kudinkin
              dzcxzl dzcxzl
              Votes:
              0 Vote for this issue
              Watchers:
              1 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: