Uploaded image for project: 'Flink'
  1. Flink
  2. FLINK-3337

mvn test fails on flink-runtime because curator classes not found

Agile BoardRank to TopRank to BottomAttach filesAttach ScreenshotBulk Copy AttachmentsBulk Move AttachmentsVotersStop watchingWatchersCreate sub-taskConvert to sub-taskLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.0.0
    • 1.0.0
    • Runtime / Coordination
    • None

    Description

      This has been reported before. I am running mvn test on an AWS c4.2xlarge, Flink HEAD (version 69f7f6d9...) and seeing the missing curator classes. For example,

      testMultipleLeaders(org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionTest)  Time elapsed: 1.042 sec  <<< ERROR!
      java.lang.NoClassDefFoundError: org/apache/curator/RetryPolicy
      	at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
      	at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
      	at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
      	at org.apache.flink.runtime.leaderelection.ZooKeeperLeaderElectionTest.testMultipleLeaders(ZooKeeperLeaderElectionTest.java:291)
      
      Tests in error: 
        JobManagerLeaderElectionTest.testLeaderElection:99->createJobManagerProps:166 NoClassDefFound
        JobManagerLeaderElectionTest.testLeaderReelection:130->createJobManagerProps:166 NoClassDefFound
        ZooKeeperLeaderElectionTest.testEphemeralZooKeeperNodes:444 NoClassDefFound or...
        ZooKeeperLeaderElectionTest.testExceptionForwarding:372 NoClassDefFound org/ap...
        ZooKeeperLeaderElectionTest.testMultipleLeaders:291 NoClassDefFound org/apache...
        ZooKeeperLeaderElectionTest.testZooKeeperLeaderElectionRetrieval:94 NoClassDefFound
        ZooKeeperLeaderElectionTest.testZooKeeperReelection:137 » NoClassDefFound org/...
        ZooKeeperLeaderElectionTest.testZooKeeperReelectionWithReplacement:207 NoClassDefFound
        ZooKeeperLeaderRetrievalTest.testConnectingAddressRetrievalWithDelayedLeaderElection:96 NoClassDefFound
        ZooKeeperLeaderRetrievalTest.testTimeoutOfFindConnectingAddress:187 » NoClassDefFound
        ZooKeeperUtilTest.testZooKeeperEnsembleConnectStringConfiguration:40 NoClassDefFound
      

      The issue is resolved when removing the curator excludes from flink-runtime/pom.xml:

                                              <classpathDependencyExcludes>
                                                      <classpathDependencyExclude>org.apache.curator:curator-recipes</classpathDependencyExclude>
                                                      <classpathDependencyExclude>org.apache.curator:curator-client</classpathDependencyExclude>
                                                      <classpathDependencyExclude>org.apache.curator:curator-framework</classpathDependencyExclude>
                                              </classpathDependencyExcludes>
      

      Attachments

        Issue Links

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            greghogan Greg Hogan
            greghogan Greg Hogan
            Votes:
            0 Vote for this issue
            Watchers:
            5 Stop watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment