Uploaded image for project: 'Hivemall'
  1. Hivemall
  2. HIVEMALL-218

Fixed train_lda NPE where input row is null

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 0.5.0
    • Fix Version/s: 0.5.2
    • Labels:
      None

      Description

      Caused by: java.lang.NegativeArraySizeException
          at hivemall.topicmodel.ProbabilisticTopicModelBaseUDTF.process(ProbabilisticTopicModelBaseUDTF.java:163)
          at org.apache.hadoop.hive.ql.exec.UDTFOperator.processOp(UDTFOperator.java:107)
          at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
          at org.apache.hadoop.hive.ql.exec.SelectOperator.processOp(SelectOperator.java:87)
          at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
          at org.apache.hadoop.hive.ql.exec.TableScanOperator.processOp(TableScanOperator.java:92)
          at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:793)
          at org.apache.hadoop.hive.ql.exec.MapOperator.process(MapOperator.java:539)
          ... 9 more

      https://github.com/apache/incubator-hivemall/blob/7b61a3be8178fef40154f4009fef2989a9fd4c49/core/src/main/java/hivemall/topicmodel/ProbabilisticTopicModelBaseUDTF.java#L163
      https://github.com/apache/hive/blob/master/serde/src/java/org/apache/hadoop/hive/serde2/objectinspector/ListObjectInspector.java#L45

        Attachments

          Issue Links

            Activity

              People

              • Assignee:
                myui Makoto Yui
                Reporter:
                myui Makoto Yui
              • Votes:
                0 Vote for this issue
                Watchers:
                1 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: