Cassandra
  1. Cassandra
  2. CASSANDRA-4196

While loading data using BulkOutPutFormat gettting an exception "java.lang.ClassCastException: org.apache.cassandra.utils.Murmur3BloomFilter cannot be cast to org.apache.cassandra.utils.Murmur2BloomFilter"

    Details

      Description

      We are using cassandra-1.1 rc1 for production setup and getting following error while bulkloading data using BulkOutPutFormat.

      WARN 09:04:52,384 Failed closing IndexWriter(/cassandra/production/Data_daily/production-Data_daily-tmp-hc-2692)
      java.lang.ClassCastException: org.apache.cassandra.utils.Murmur3BloomFilter cannot be cast to org.apache.cassandra.utils.Murmur2BloomFilter
              at org.apache.cassandra.utils.FilterFactory.serialize(FilterFactory.java:50)
              at org.apache.cassandra.io.sstable.SSTableWriter$IndexWriter.close(SSTableWriter.java:410)
              at org.apache.cassandra.io.util.FileUtils.closeQuietly(FileUtils.java:94)
              at org.apache.cassandra.io.sstable.SSTableWriter.abort(SSTableWriter.java:255)
              at org.apache.cassandra.streaming.IncomingStreamReader.streamIn(IncomingStreamReader.java:154)
              at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
              at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:178)
              at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:74)
       WARN 09:04:52,393 Failed closing IndexWriter(/cassandra/production/Data_daily/production-Data_daily-tmp-hc-2693)
      java.lang.ClassCastException: org.apache.cassandra.utils.Murmur3BloomFilter cannot be cast to org.apache.cassandra.utils.Murmur2BloomFilter
              at org.apache.cassandra.utils.FilterFactory.serialize(FilterFactory.java:50)
              at org.apache.cassandra.io.sstable.SSTableWriter$IndexWriter.close(SSTableWriter.java:410)
              at org.apache.cassandra.io.util.FileUtils.closeQuietly(FileUtils.java:94)
              at org.apache.cassandra.io.sstable.SSTableWriter.abort(SSTableWriter.java:255)
              at org.apache.cassandra.streaming.IncomingStreamReader.streamIn(IncomingStreamReader.java:154)
              at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
              at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:178)
              at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:74)
       WARN 09:04:52,544 Failed closing IndexWriter(/cassandra/production/Data_daily/production-Data_daily-tmp-hc-2698)
      java.lang.ClassCastException: org.apache.cassandra.utils.Murmur3BloomFilter cannot be cast to org.apache.cassandra.utils.Murmur2BloomFilter
              at org.apache.cassandra.utils.FilterFactory.serialize(FilterFactory.java:50)
              at org.apache.cassandra.io.sstable.SSTableWriter$IndexWriter.close(SSTableWriter.java:410)
              at org.apache.cassandra.io.util.FileUtils.closeQuietly(FileUtils.java:94)
              at org.apache.cassandra.io.sstable.SSTableWriter.abort(SSTableWriter.java:255)
              at org.apache.cassandra.streaming.IncomingStreamReader.streamIn(IncomingStreamReader.java:154)
              at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
              at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:178)
              at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:74)
      ERROR 09:04:52,544 Exception in thread Thread[Thread-39,5,main]
      [3:02:34 PM] Mariusz Dymarek: java.lang.IndexOutOfBoundsException
              at java.nio.Buffer.checkIndex(Buffer.java:520)
              at java.nio.HeapByteBuffer.getShort(HeapByteBuffer.java:289)
              at org.apache.cassandra.db.CounterColumn.create(CounterColumn.java:79)
              at org.apache.cassandra.db.ColumnSerializer.deserialize(ColumnSerializer.java:102)
              at org.apache.cassandra.io.util.ColumnIterator.deserializeNext(ColumnSortedMap.java:251)
              at org.apache.cassandra.io.util.ColumnIterator.next(ColumnSortedMap.java:271)
              at org.apache.cassandra.io.util.ColumnIterator.next(ColumnSortedMap.java:228)
              at edu.stanford.ppl.concurrent.SnapTreeMap.<init>(SnapTreeMap.java:453)
              at org.apache.cassandra.db.AtomicSortedColumns$Holder.<init>(AtomicSortedColumns.java:301)
              at org.apache.cassandra.db.AtomicSortedColumns.<init>(AtomicSortedColumns.java:77)
              at org.apache.cassandra.db.AtomicSortedColumns.<init>(AtomicSortedColumns.java:48)
              at org.apache.cassandra.db.AtomicSortedColumns$1.fromSorted(AtomicSortedColumns.java:61)
              at org.apache.cassandra.db.SuperColumnSerializer.deserialize(SuperColumn.java:398)
              at org.apache.cassandra.io.sstable.SSTableWriter.appendFromStream(SSTableWriter.java:211)
              at org.apache.cassandra.streaming.IncomingStreamReader.streamIn(IncomingStreamReader.java:142)
              at org.apache.cassandra.streaming.IncomingStreamReader.read(IncomingStreamReader.java:92)
              at org.apache.cassandra.net.IncomingTcpConnection.stream(IncomingTcpConnection.java:178)
              at org.apache.cassandra.net.IncomingTcpConnection.run(IncomingTcpConnection.java:74)
       INFO 09:04:52,548 Streaming of file /opera/log1/hadoop/mapred/local/taskTracker/jobcache/job_201111101207_320989/attempt_201111101207_320989_m_000014_0/work/tmp/production/Data_daily/production-Data_daily-hc-1-Data.db sections=1 progress=0/21544606 - 0% for org.apache.cassandra.streaming.StreamInSession@49bbb2d4 failed: requesting a retry.
      

      I tried to check into the code and it seems like "Murmur3BloomFilter" and "Murmur2BloomFilter" are recently added classes and might be causing this issue.

        Activity

        Gavin made changes -
        Workflow patch-available, re-open possible [ 12749631 ] reopen-resolved, no closed status, patch-avail, testing [ 12757140 ]
        Gavin made changes -
        Workflow no-reopen-closed, patch-avail [ 12664886 ] patch-available, re-open possible [ 12749631 ]
        Jonathan Ellis made changes -
        Fix Version/s 1.2 [ 12319262 ]
        Vijay made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Resolution Won't Fix [ 2 ]
        Dave Brosius made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Jonathan Ellis made changes -
        Assignee Vijay [ vijay2win@yahoo.com ] Dave Brosius [ dbrosius ]
        Fix Version/s 1.2 [ 12319262 ]
        Fix Version/s 1.1.1 [ 12319857 ]
        Affects Version/s 1.2 [ 12319262 ]
        Affects Version/s 1.1.0 [ 12317615 ]
        Dave Brosius made changes -
        Field Original Value New Value
        Attachment 4196_create_correct_bf_type.diff [ 12525083 ]
        Samarth Gahire created issue -

          People

          • Assignee:
            Dave Brosius
            Reporter:
            Samarth Gahire
            Reviewer:
            Pavel Yaskevich
          • Votes:
            1 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 48h
              48h
              Remaining:
              Remaining Estimate - 48h
              48h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development