Uploaded image for project: 'Apache Cassandra'
  1. Apache Cassandra
  2. CASSANDRA-8864

NPE in CQLSSTableWriter when bulk loading data from Hadoop

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Normal
    • Resolution: Duplicate
    • None
    • None
    • None
    • Normal

    Description

      CASSANDRA-8280 introduced a bug in CQLSSTableWriter when used by CqlBulkRecordWriter. It assumes fields in the DatabaseDescriptor is set when they are not, causing NPE.

      Relevant stack trace below.

      Error: java.lang.NullPointerException at org.apache.cassandra.config.DatabaseDescriptor.createAllDirectories(DatabaseDescriptor.java:605)
      at org.apache.cassandra.db.Keyspace.<clinit>(Keyspace.java:73)
      at org.apache.cassandra.cql3.statements.UpdateStatement.addUpdateForKey(UpdateStatement.java:109)
      at org.apache.cassandra.io.sstable.CQLSSTableWriter.rawAddRow(CQLSSTableWriter.java:218)
      at com.spotify.hdfs2cass.cassandra.cql.CrunchCqlBulkRecordWriter.write(CrunchCqlBulkRecordWriter.java:114)
      at com.spotify.hdfs2cass.cassandra.cql.CrunchCqlBulkRecordWriter.write(CrunchCqlBulkRecordWriter.java:51)
      at org.apache.crunch.io.CrunchOutputs.write(CrunchOutputs.java:133)
      at org.apache.crunch.impl.mr.emit.MultipleOutputEmitter.emit(MultipleOutputEmitter.java:41)
      at org.apache.crunch.MapFn.process(MapFn.java:34)

      Attachments

        Issue Links

          Activity

            People

              blerer Benjamin Lerer
              yarin Jimmy MÃ¥rdell
              Benjamin Lerer
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: