Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-19808

GenericUDTFGetSplits should support ACID reads in the temp. table read path

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • None
    • 3.1.0
    • Transactions
    • None

    Description

      1. Map-only reads work on ACID tables.
      2. Temp. table reads (for multi-vertex queries) work on non-ACID tables.
      3. But temp. table reads don't work on ACID tables.

      Caused by: org.apache.hadoop.hive.ql.metadata.HiveException: Failed to create temp table: java.lang.IllegalStateException: calling recordValidTxn() more than once in the same txnid:420
      	at org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.createPlanFragment(GenericUDTFGetSplits.java:303)
      	at org.apache.hadoop.hive.ql.udf.generic.GenericUDTFGetSplits.process(GenericUDTFGetSplits.java:202)
      	at org.apache.hadoop.hive.ql.exec.UDTFOperator.process(UDTFOperator.java:116)
      	at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:985)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:931)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:918)
      	at org.apache.hadoop.hive.ql.exec.SelectOperator.process(SelectOperator.java:95)
      	at org.apache.hadoop.hive.ql.exec.Operator.baseForward(Operator.java:985)
      	at org.apache.hadoop.hive.ql.exec.Operator.forward(Operator.java:931)
      	at org.apache.hadoop.hive.ql.exec.TableScanOperator.process(TableScanOperator.java:125)
      	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:492)
      	at org.apache.hadoop.hive.ql.exec.FetchOperator.pushRow(FetchOperator.java:484)
      	at org.apache.hadoop.hive.ql.exec.FetchTask.fetch(FetchTask.java:145)
      	... 16 more
      

      Attachments

        1. HIVE-19808.1.patch
          3 kB
          Eric Wohlstadter
        2. HIVE-19808.2.patch
          0.9 kB
          Eric Wohlstadter

        Activity

          People

            ewohlstadter Eric Wohlstadter
            ewohlstadter Eric Wohlstadter
            Votes:
            0 Vote for this issue
            Watchers:
            5 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: