[CASSANDRA-8653] Upgrading to trunk with auth throws exception

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Not A Problem
• Fix Version/s: 3.0.0
• Component/s: Legacy/Distributed Metadata, Legacy/Testing
• Severity: Normal
• Assignee: Sam Tunnicliffe
• Reporter: Philip Thompson

Authors

Sam Tunnicliffe

• Created: 20/Jan/15 19:07
• Updated: 16/Apr/19 09:31
• Resolved: 30/Oct/15 16:36

Description

When running Sam's upgrade_internal_auth_dtest, I am seeing the following exception (amongst others) in the log file of the second node to be upgraded to trunk from 2.1:

ERROR [GossipStage:1] 2015-01-20 13:46:21,679 CassandraDaemon.java:170 - Exception in thread Thread[GossipStage:1,5,main]
java.lang.NoClassDefFoundError: org/apache/cassandra/transport/Event$TopologyChange$Change
        at org.apache.cassandra.transport.Server$EventNotifier.onJoinCluster(Server.java:374) ~[main/:na]
        at org.apache.cassandra.service.StorageService.handleStateNormal(StorageService.java:1668) ~[main/:na]
        at org.apache.cassandra.service.StorageService.onChange(StorageService.java:1384) ~[main/:na]
        at org.apache.cassandra.gms.Gossiper.doOnChangeNotifications(Gossiper.java:1094) ~[main/:na]
        at org.apache.cassandra.gms.Gossiper.applyNewStates(Gossiper.java:1076) ~[main/:na]
        at org.apache.cassandra.gms.Gossiper.applyStateLocally(Gossiper.java:1034) ~[main/:na]
        at org.apache.cassandra.gms.GossipDigestAckVerbHandler.doVerb(GossipDigestAckVerbHandler.java:58) ~[main/:na]
1554 - Node /127.0.0.1 state jump to normal
ERROR [GossipStage:1] 2015-01-20 13:46:21,679 CassandraDaemon.java
:170 - Exception in thread Thread[GossipStage:1,5,main]
java.lang.NoClassDefFoundError: org/apache/cassandra/transport/Eve
nt$TopologyChange$Change
        at org.apache.cassandra.transport.Server$EventNotifier.onJ
oinCluster(Server.java:374) ~[main/:na]
        at org.apache.cassandra.service.StorageService.handleState
Normal(StorageService.java:1668) ~[main/:na]
        at org.apache.cassandra.service.StorageService.onChange(St
orageService.java:1384) ~[main/:na]
        at org.apache.cassandra.gms.Gossiper.doOnChangeNotificatio
ns(Gossiper.java:1094) ~[main/:na]
        at org.apache.cassandra.gms.Gossiper.applyNewStates(Gossip
er.java:1076) ~[main/:na]
        at org.apache.cassandra.gms.Gossiper.applyStateLocally(Gos
siper.java:1034) ~[main/:na]
        at org.apache.cassandra.gms.GossipDigestAckVerbHandler.doV
erb(GossipDigestAckVerbHandler.java:58) ~[main/:na]
        at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:62) ~[main/:na]
        at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145) ~[na:1.7.0_67]
        at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615) ~[na:1.7.0_67]
        at java.lang.Thread.run(Thread.java:745) ~[na:1.7.0_67]
Caused by: java.lang.ClassNotFoundException: org.apache.cassandra.transport.Event$TopologyChange$Change
        at java.net.URLClassLoader$1.run(URLClassLoader.java:366) ~[na:1.7.0_67]
        at java.net.URLClassLoader$1.run(URLClassLoader.java:355) ~[na:1.7.0_67]
        at java.security.AccessController.doPrivileged(Native Method) ~[na:1.7.0_67]
        at java.net.URLClassLoader.findClass(URLClassLoader.java:354) ~[na:1.7.0_67]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:425) ~[na:1.7.0_67]
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:308) ~[na:1.7.0_67]
        at java.lang.ClassLoader.loadClass(ClassLoader.java:358) ~[na:1.7.0_67]
        ... 11 common frames omitted
WARN  [Thread-10] 2015-01-20 13:46:34,500 IncomingTcpConnection.java:91 - UnknownColumnFamilyException reading from socket; closing
org.apache.cassandra.db.UnknownColumnFamilyException: Couldn't find cfId=5f2fbdad-91f1-3946-bd25-d5da3a5c35ec
        at org.apache.cassandra.db.ColumnFamilySerializer.deserializeCfId(ColumnFamilySerializer.java:164) ~[main/:na]
        at org.apache.cassandra.db.ColumnFamilySerializer.deserialize(ColumnFamilySerializer.java:97) ~[main/:na]
        at org.apache.cassandra.db.Mutation$MutationSerializer.deserializeOneCf(Mutation.java:322) ~[main/:na]
        at org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:302) ~[main/:na]
        at org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:330) ~[main/:na]
        at org.apache.cassandra.db.Mutation$MutationSerializer.deserialize(Mutation.java:272) ~[main/:na]
        at org.apache.cassandra.net.MessageIn.read(MessageIn.java:99) ~[main/:na]
        at org.apache.cassandra.net.IncomingTcpConnection.receiveMessage(IncomingTcpConnection.java:168) ~[main/:na]
        at org.apache.cassandra.net.IncomingTcpConnection.receiveMessages(IncomingTcpConnection.java:150) ~[main/:na]
        at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:82) ~[main/:na]

I have included the logs of all three nodes.