Uploaded image for project: 'Cassandra'
  1. Cassandra
  2. CASSANDRA-7198

CqlPagingRecordReader throws IllegalStateException

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Low
    • Resolution: Fixed
    • Fix Version/s: 2.0.9
    • Component/s: None
    • Labels:
      None
    • Environment:

      Spark with Calliope EA against Cassandra 2.0.7

    • Severity:
      Low
    • Since Version:

      Description

      Getting the following exception when running a Spark job that does not specify cassandra.input.page.row.size:

      14/05/08 14:30:43 ERROR executor.Executor: Exception in task ID 12
      java.lang.IllegalStateException: Optional.get() cannot be called on an absent value
              at com.google.common.base.Absent.get(Absent.java:47)
              at org.apache.cassandra.hadoop.cql3.CqlPagingRecordReader.initialize(CqlPagingRecordReader.java:120)
              at com.tuplejump.calliope.cql3.Cql3CassandraRDD$$anon$1.<init>(Cql3CassandraRDD.scala:65)
              at com.tuplejump.calliope.cql3.Cql3CassandraRDD.compute(Cql3CassandraRDD.scala:53)
              at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
              at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
              at org.apache.spark.rdd.MappedRDD.compute(MappedRDD.scala:31)
              at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
              at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
              at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:109)
              at org.apache.spark.scheduler.Task.run(Task.scala:53)
              at org.apache.spark.executor.Executor$TaskRunner$$anonfun$run$1.apply$mcV$sp(Executor.scala:213)
              at org.apache.spark.deploy.SparkHadoopUtil.runAsUser(SparkHadoopUtil.scala:49)
              at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:178)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:744)
      14/05/08 14:30:43 ERROR executor.Executor: Exception in task ID 21
      java.lang.IllegalStateException: Optional.get() cannot be called on an absent value
              at com.google.common.base.Absent.get(Absent.java:47)
              at org.apache.cassandra.hadoop.cql3.CqlPagingRecordReader.initialize(CqlPagingRecordReader.java:120)
              at com.tuplejump.calliope.cql3.Cql3CassandraRDD$$anon$1.<init>(Cql3CassandraRDD.scala:65)
              at com.tuplejump.calliope.cql3.Cql3CassandraRDD.compute(Cql3CassandraRDD.scala:53)
              at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
              at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
              at org.apache.spark.rdd.MappedRDD.compute(MappedRDD.scala:31)
              at org.apache.spark.rdd.RDD.computeOrReadCheckpoint(RDD.scala:241)
              at org.apache.spark.rdd.RDD.iterator(RDD.scala:232)
              at org.apache.spark.scheduler.ResultTask.runTask(ResultTask.scala:109)
              at org.apache.spark.scheduler.Task.run(Task.scala:53)
              at org.apache.spark.executor.Executor$TaskRunner$$anonfun$run$1.apply$mcV$sp(Executor.scala:213)
              at org.apache.spark.deploy.SparkHadoopUtil.runAsUser(SparkHadoopUtil.scala:49)
              at org.apache.spark.executor.Executor$TaskRunner.run(Executor.scala:178)
              at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
              at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
              at java.lang.Thread.run(Thread.java:744)
      

      Reason why is CqlPagingRecordReader catching the wrong exception type. Patch attached.

        Attachments

        1. trunk-7198-2.txt
          2 kB
          Brent Theisen

          Activity

            People

            • Assignee:
              brenttheisen Brent Theisen
              Reporter:
              brenttheisen Brent Theisen
              Authors:
              Brent Theisen
              Reviewers:
              David Brosius
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: