[CASSANDRA-5476] Exceptions in 1.1 nodes with 1.2 nodes in ring

• Type: Bug
• Status: Resolved
• Priority: Normal
• Resolution: Fixed
• Fix Version/s: 1.2.6
• Severity: Normal
• Assignee: Unassigned
• Reporter: John Watson

Reviewers

Aleksey Yeschenko

• Created: 16/Apr/13 07:36
• Updated: 16/Apr/19 09:32
• Resolved: 22/Jun/13 13:58

Description

As 1.1.9 nodes were being upgraded to 1.2.3 nodes, the 1.1.9 nodes started having this exception:

    Exception in thread Thread[RequestResponseStage:19496,5,main]
    java.io.IOError: java.io.EOFException
            at org.apache.cassandra.service.AbstractRowResolver.preprocess(AbstractRowResolver.java:71)
            at org.apache.cassandra.service.ReadCallback.response(ReadCallback.java:155)
            at org.apache.cassandra.net.ResponseVerbHandler.doVerb(ResponseVerbHandler.java:45)
            at org.apache.cassandra.net.MessageDeliveryTask.run(MessageDeliveryTask.java:59)
            at java.util.concurrent.ThreadPoolExecutor$Worker.runTask(ThreadPoolExecutor.java:886)
            at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:908)
            at java.lang.Thread.run(Thread.java:662)
    Caused by: java.io.EOFException
            at java.io.DataInputStream.readFully(DataInputStream.java:180)
            at org.apache.cassandra.db.ReadResponseSerializer.deserialize(ReadResponse.java:100)
            at org.apache.cassandra.db.ReadResponseSerializer.deserialize(ReadResponse.java:81)
            at org.apache.cassandra.service.AbstractRowResolver.preprocess(AbstractRowResolver.java:64)
            ... 6 more

As more 1.2.3 nodes were upgraded, the 1.2.3 nodes began logging for 1.1.9 node IPs:

    Unable to store hint for host with missing ID, /10.37.62.71 (old node?)