Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7163

ReduceRecordProcessor adds null values to getShuffleInputs - Causing NPE

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: None
    • Component/s: None
    • Labels:

      Description

      2014-06-01 22:35:55,435 ERROR TezChild org.apache.hadoop.hive.ql.exec.tez.TezProcessor: java.lang.RuntimeException: java.lang.NullPointerException
      at org.apache.tez.runtime.InputReadyTracker$InputReadyMonitor.<init>(InputReadyTracker.java:111)
      at org.apache.tez.runtime.InputReadyTracker.waitForAllInputsReady(InputReadyTracker.java:90)
      at org.apache.tez.runtime.api.impl.TezProcessorContextImpl.waitForAllInputsReady(TezProcessorContextImpl.java:109)
      at org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor.run(ReduceRecordProcessor.java:198)
      at org.apache.hadoop.hive.ql.exec.tez.TezProcessor.run(TezProcessor.java:165)
      at org.apache.tez.runtime.LogicalIOProcessorRuntimeTask.run(LogicalIOProcessorRuntimeTask.java:307)
      at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:181)
      at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable$1.run(TezTaskRunner.java:173)
      at java.security.AccessController.doPrivileged(Native Method)
      at javax.security.auth.Subject.doAs(Subject.java:415)
      at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1548)
      at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:173)
      at org.apache.tez.runtime.task.TezTaskRunner$TaskRunnerCallable.call(TezTaskRunner.java:168)
      at java.util.concurrent.FutureTask$Sync.innerRun(FutureTask.java:334)
      at java.util.concurrent.FutureTask.run(FutureTask.java:166)
      at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1145)
      at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:615)
      at java.lang.Thread.run(Thread.java:724)
      Caused by: java.lang.NullPointerException
      at java.util.concurrent.ConcurrentHashMap.hash(ConcurrentHashMap.java:333)
      at java.util.concurrent.ConcurrentHashMap.put(ConcurrentHashMap.java:1125)
      at java.util.Collections$SetFromMap.add(Collections.java:3903)
      at java.util.AbstractCollection.addAll(AbstractCollection.java:334)
      at org.apache.tez.runtime.InputReadyTracker$InputReadyMonitor.<init>(InputReadyTracker.java:102)
      ... 17 more

      ReduceRecordProcessor.getShuffleInputs() adds "null" values to ShuffleInputs. This is passed on to to org.apache.hadoop.hive.ql.exec.tez.ReduceRecordProcessor: getShuffleInputs : null, null

      Environment: Latest codebase

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              rajesh.balamohan Rajesh Balamohan
            • Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

              • Created:
                Updated: