Hive
  1. Hive
  2. HIVE-3253

ArrayIndexOutOfBounds exception for deeply nested structs

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0, 0.10.0
    • Fix Version/s: 0.12.0
    • Labels:
      None
    • Release Note:
      Hide
      This change increases the number of levels of nesting supported in hive select queries. The limitation in the serialization format used by File Output Operator for these queries (LazySimpleSerde) was restricted the number of levels of nesting to 8 earlier, this has now been extended to 24. This extended levels of nesting is turned on by default.

      This change also improves the number of levels of nesting that you can use with tables that use LazySimpleSerde. It uses additional control charactors as delimiters. This means that your data should not have these charactors or you need to escape these charactors. As this change introduces a new requirement for the way data has been written, this is not backward compatible. Hence this is not enabled by default. To enabled this, you need to set the serde property hive.serialization.extend.nesting.levels to true.

      Look at 'ESCAPED BY' documentation for create-table, to learn how to enable escaping of the delimiter charactors. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL
      Show
      This change increases the number of levels of nesting supported in hive select queries. The limitation in the serialization format used by File Output Operator for these queries (LazySimpleSerde) was restricted the number of levels of nesting to 8 earlier, this has now been extended to 24. This extended levels of nesting is turned on by default. This change also improves the number of levels of nesting that you can use with tables that use LazySimpleSerde. It uses additional control charactors as delimiters. This means that your data should not have these charactors or you need to escape these charactors. As this change introduces a new requirement for the way data has been written, this is not backward compatible. Hence this is not enabled by default. To enabled this, you need to set the serde property hive.serialization.extend.nesting.levels to true. Look at 'ESCAPED BY' documentation for create-table, to learn how to enable escaping of the delimiter charactors. https://cwiki.apache.org/confluence/display/Hive/LanguageManual+DDL

      Description

      It was observed that while creating table with deeply nested structs might throw this exception:

      java.lang.ArrayIndexOutOfBoundsException: 9
              at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:281)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:263)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:276)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:263)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:276)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:263)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:276)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:263)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyObjectInspector(LazyFactory.java:276)
      	at org.apache.hadoop.hive.serde2.lazy.LazyFactory.createLazyStructInspector(LazyFactory.java:354)
      

      The reason being that currently the separators array has been hardcoded to be of size 8 in the LazySimpleSerde.

      // Read the separators: We use 8 levels of separators by default, but we
      // should change this when we allow users to specify more than 10 levels
      // of separators through DDL.
      serdeParams.separators = new byte[8];
      

      If possible, we should increase this size or at least make it configurable to properly handle deeply nested structs.

      1. jsonout.hive
        16 kB
        Chuck Connell
      2. HIVE-3253.3.patch
        158 kB
        Thejas M Nair
      3. HIVE-3253.2.patch
        139 kB
        Thejas M Nair
      4. HIVE-3253_moar_nesting.1.patch
        0.9 kB
        Travis Crawford

        Issue Links

          Activity

          Hide
          Travis Crawford added a comment -

          I ran into this issue too. I'm running tests with that value doubled to 16.

          Show
          Travis Crawford added a comment - I ran into this issue too. I'm running tests with that value doubled to 16.
          Hide
          Travis Crawford added a comment -

          I ran the full test suite (test report) increasing the number of separators to 16 and there were two failures:

          • org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_nulls
          • org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1

          Neither look related to this change, and they still failed after reverting the change & rerunning just those tests. AFAICT increasing this constant is a safe thing to do.

          Show
          Travis Crawford added a comment - I ran the full test suite ( test report ) increasing the number of separators to 16 and there were two failures: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_join_nulls org.apache.hadoop.hive.ql.TestMTQueries.testMTQueries1 Neither look related to this change, and they still failed after reverting the change & rerunning just those tests. AFAICT increasing this constant is a safe thing to do.
          Hide
          Ashutosh Chauhan added a comment -

          This needs a testcase. I will suggest to add one testcase for each of text, avro and thrift. Also, 16 sounds lower. Assuming its safe, we should bump it higher. 64?

          Show
          Ashutosh Chauhan added a comment - This needs a testcase. I will suggest to add one testcase for each of text, avro and thrift. Also, 16 sounds lower. Assuming its safe, we should bump it higher. 64?
          Hide
          Chuck Connell added a comment -

          Test case of a large, deeply nested table definition. This is our real case that is failing.

          Show
          Chuck Connell added a comment - Test case of a large, deeply nested table definition. This is our real case that is failing.
          Hide
          Swarnim Kulkarni added a comment -

          @Ashutosh - What I fail to understand is why do we have to hardcode this value? Instead why can't we go for a better solution where array can be dynamically resized based on requirement?

          Show
          Swarnim Kulkarni added a comment - @Ashutosh - What I fail to understand is why do we have to hardcode this value? Instead why can't we go for a better solution where array can be dynamically resized based on requirement?
          Hide
          Mark Grover added a comment -

          +1 on Swarnim's comment.

          Show
          Mark Grover added a comment - +1 on Swarnim's comment.
          Hide
          Namit Jain added a comment -

          Swarnim Kulkarni, I agree with you that this needs a better, dynamic solution. But, dont you think we should get it in
          to get a work-around for the current scenario, and then proceed for the general solution ?

          Show
          Namit Jain added a comment - Swarnim Kulkarni , I agree with you that this needs a better, dynamic solution. But, dont you think we should get it in to get a work-around for the current scenario, and then proceed for the general solution ?
          Hide
          Thejas M Nair added a comment -

          HIVE-3253.2.patch

          • It increases the number of control charactors used by LazySimpleSerde, avoiding the chars that are likely to be present in data. Using new control chars is not backward compatible change, so you need to set the serde property hive.serialization.extend.nesting.levels to enable it for a table that is using LazySimpleSerde. If your input table has data that might contain these delimiter control chars, you should escape the delimiter chars, and set escape char using serde property.

          Example :

          create table nestedcomplex (
          simple_int int,
          max_nested_array  array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<int>>>>>>>>>>>>>>>>>>>>>>>)
          ROW FORMAT SERDE
            'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe'
          WITH SERDEPROPERTIES (  'hive.serialization.extend.nesting.levels'='true'
          )
          ;
          
          • LazySimpleSerde is used by FileSyncOperator, that is why it was limited by the number of levels of nesting supported by the serde. We should look at using LazyBinarySerde here as it would be more efficient and can go beyond this nesting level restriction.
          • LazySimpleSerde used in FileSyncOperator has escaping enabled, so it is safe to extend the levels of nesting using the new serde property for that use case.
          • The patch has fix to give better error message when the levels of nesting exceeds maximum supported levels (not an ArrayIndexOutOfBounds exception anymore)
          Show
          Thejas M Nair added a comment - HIVE-3253 .2.patch It increases the number of control charactors used by LazySimpleSerde, avoiding the chars that are likely to be present in data. Using new control chars is not backward compatible change, so you need to set the serde property hive.serialization.extend.nesting.levels to enable it for a table that is using LazySimpleSerde. If your input table has data that might contain these delimiter control chars, you should escape the delimiter chars, and set escape char using serde property. Example : create table nestedcomplex ( simple_int int , max_nested_array array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array<array< int >>>>>>>>>>>>>>>>>>>>>>>) ROW FORMAT SERDE 'org.apache.hadoop.hive.serde2.lazy.LazySimpleSerDe' WITH SERDEPROPERTIES ( 'hive.serialization.extend.nesting.levels'=' true ' ) ; LazySimpleSerde is used by FileSyncOperator, that is why it was limited by the number of levels of nesting supported by the serde. We should look at using LazyBinarySerde here as it would be more efficient and can go beyond this nesting level restriction. LazySimpleSerde used in FileSyncOperator has escaping enabled, so it is safe to extend the levels of nesting using the new serde property for that use case. The patch has fix to give better error message when the levels of nesting exceeds maximum supported levels (not an ArrayIndexOutOfBounds exception anymore)
          Hide
          Thejas M Nair added a comment -

          Note that with changes in HIVE-3253.2.patch, the serde property has to be set to get extended nesting levels only if your tables are using the serde LazySimpleSerde .

          Show
          Thejas M Nair added a comment - Note that with changes in HIVE-3253 .2.patch, the serde property has to be set to get extended nesting levels only if your tables are using the serde LazySimpleSerde .
          Hide
          Thejas M Nair added a comment -
          Show
          Thejas M Nair added a comment - Reviewboard link - https://reviews.apache.org/r/11854/
          Hide
          Thejas M Nair added a comment -

          Note that LazySimpleSerde is used by hive-server2 as the FetchTask serde (using hive.fetch.output.serde). So this would also increase the levels of nesting supported by hive server2.

          Show
          Thejas M Nair added a comment - Note that LazySimpleSerde is used by hive-server2 as the FetchTask serde (using hive.fetch.output.serde). So this would also increase the levels of nesting supported by hive server2.
          Hide
          Ashutosh Chauhan added a comment -

          Patch looks good. +1

          Show
          Ashutosh Chauhan added a comment - Patch looks good. +1
          Hide
          Ashutosh Chauhan added a comment -

          Thejas M Nair Can you also test your patch through 0.23 profile? There are quite a few updates in .q.out files and we have tests which run only on 0.23 profile. If they didn't get updated for new property, they will be broken again.

          Show
          Ashutosh Chauhan added a comment - Thejas M Nair Can you also test your patch through 0.23 profile? There are quite a few updates in .q.out files and we have tests which run only on 0.23 profile. If they didn't get updated for new property, they will be broken again.
          Hide
          Thejas M Nair added a comment -

          Running tests with hadoop.mr.rev=23 . Will update the jira once tests are done.

          Show
          Thejas M Nair added a comment - Running tests with hadoop.mr.rev=23 . Will update the jira once tests are done.
          Hide
          Thejas M Nair added a comment -

          HIVE-3253.3.patch - includes 0.23 .q.out file changes, also ran with default to check if any other newly added tests need to be updated.

          Show
          Thejas M Nair added a comment - HIVE-3253 .3.patch - includes 0.23 .q.out file changes, also ran with default to check if any other newly added tests need to be updated.
          Hide
          Ashutosh Chauhan added a comment -

          Quite a big patch : ) Can you also update RB entry?

          Show
          Ashutosh Chauhan added a comment - Quite a big patch : ) Can you also update RB entry?
          Hide
          Thejas M Nair added a comment -

          Sorry about that, update RB link as well.
          The new patch just has additional .q.out changes.

          Show
          Thejas M Nair added a comment - Sorry about that, update RB link as well. The new patch just has additional .q.out changes.
          Hide
          Ashutosh Chauhan added a comment -

          +1

          Show
          Ashutosh Chauhan added a comment - +1
          Hide
          Ashutosh Chauhan added a comment -

          Committed to trunk. Thanks, Thejas!
          Thejas M Nair Can you also update the release notes on jira for this since its an user facing change.

          Show
          Ashutosh Chauhan added a comment - Committed to trunk. Thanks, Thejas! Thejas M Nair Can you also update the release notes on jira for this since its an user facing change.
          Hide
          Hudson added a comment -

          Integrated in Hive-trunk-h0.21 #2177 (See https://builds.apache.org/job/Hive-trunk-h0.21/2177/)
          HIVE-3253 : ArrayIndexOutOfBounds exception for deeply nested structs (Thejas Nair via Ashutosh Chauhan) (Revision 1499450)

          Result = FAILURE
          hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1499450
          Files :

          • /hive/trunk/data/files/nested_complex.txt
          • /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/TestLazyHBaseObject.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java
          • /hive/trunk/ql/src/test/queries/clientnegative/nested_complex_neg.q
          • /hive/trunk/ql/src/test/queries/clientpositive/nested_complex.q
          • /hive/trunk/ql/src/test/results/clientnegative/nested_complex_neg.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/alter_partition_coltype.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_4.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin10.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin11.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin12.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin13.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/columnstats_partlvl.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/columnstats_tbllvl.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/combine2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/combine2_hadoop20.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/filter_join_breaktask.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input23.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input42.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input_part7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input_part9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/join_filters_overlap.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_12.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_13.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_4.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/louter_join_ppr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/macro.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/metadataonly1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/nested_complex.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/outer_join_ppr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/ppd_join_filter.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/regexp_extract.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/router_join_ppr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample10.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_15.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/transform_ppr1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/transform_ppr2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_explode.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_java_method.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_reflect.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_reflect2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udtf_explode.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/union24.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/union_ppr.q.out
          • /hive/trunk/ql/src/test/results/compiler/plan/cast1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby2.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby3.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby4.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby5.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby6.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input20.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input8.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input_part1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath2.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join4.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join5.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join6.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join7.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join8.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/sample1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf4.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf6.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf_case.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf_when.q.xml
          • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java
          • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java
          • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java
          • /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyArrayMapStruct.java
          Show
          Hudson added a comment - Integrated in Hive-trunk-h0.21 #2177 (See https://builds.apache.org/job/Hive-trunk-h0.21/2177/ ) HIVE-3253 : ArrayIndexOutOfBounds exception for deeply nested structs (Thejas Nair via Ashutosh Chauhan) (Revision 1499450) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1499450 Files : /hive/trunk/data/files/nested_complex.txt /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/TestLazyHBaseObject.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java /hive/trunk/ql/src/test/queries/clientnegative/nested_complex_neg.q /hive/trunk/ql/src/test/queries/clientpositive/nested_complex.q /hive/trunk/ql/src/test/results/clientnegative/nested_complex_neg.q.out /hive/trunk/ql/src/test/results/clientpositive/alter_partition_coltype.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_1.q.out /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_2.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_1.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_2.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_3.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_4.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_5.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_6.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_7.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_8.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin1.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin10.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin11.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin12.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin13.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin7.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin8.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out /hive/trunk/ql/src/test/results/clientpositive/columnstats_partlvl.q.out /hive/trunk/ql/src/test/results/clientpositive/columnstats_tbllvl.q.out /hive/trunk/ql/src/test/results/clientpositive/combine2.q.out /hive/trunk/ql/src/test/results/clientpositive/combine2_hadoop20.q.out /hive/trunk/ql/src/test/results/clientpositive/filter_join_breaktask.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_1.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out /hive/trunk/ql/src/test/results/clientpositive/input23.q.out /hive/trunk/ql/src/test/results/clientpositive/input42.q.out /hive/trunk/ql/src/test/results/clientpositive/input_part7.q.out /hive/trunk/ql/src/test/results/clientpositive/input_part9.q.out /hive/trunk/ql/src/test/results/clientpositive/join_filters_overlap.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_12.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_13.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_2.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_3.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_4.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_5.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_7.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_8.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_9.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out /hive/trunk/ql/src/test/results/clientpositive/louter_join_ppr.q.out /hive/trunk/ql/src/test/results/clientpositive/macro.q.out /hive/trunk/ql/src/test/results/clientpositive/metadataonly1.q.out /hive/trunk/ql/src/test/results/clientpositive/nested_complex.q.out /hive/trunk/ql/src/test/results/clientpositive/outer_join_ppr.q.out /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out /hive/trunk/ql/src/test/results/clientpositive/ppd_join_filter.q.out /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out /hive/trunk/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out /hive/trunk/ql/src/test/results/clientpositive/regexp_extract.q.out /hive/trunk/ql/src/test/results/clientpositive/router_join_ppr.q.out /hive/trunk/ql/src/test/results/clientpositive/sample10.q.out /hive/trunk/ql/src/test/results/clientpositive/sample6.q.out /hive/trunk/ql/src/test/results/clientpositive/sample8.q.out /hive/trunk/ql/src/test/results/clientpositive/sample9.q.out /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin9.q.out /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_15.q.out /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out /hive/trunk/ql/src/test/results/clientpositive/transform_ppr1.q.out /hive/trunk/ql/src/test/results/clientpositive/transform_ppr2.q.out /hive/trunk/ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_explode.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_java_method.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_reflect.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_reflect2.q.out /hive/trunk/ql/src/test/results/clientpositive/udtf_explode.q.out /hive/trunk/ql/src/test/results/clientpositive/union24.q.out /hive/trunk/ql/src/test/results/clientpositive/union_ppr.q.out /hive/trunk/ql/src/test/results/compiler/plan/cast1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby2.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby3.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby4.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby5.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby6.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input20.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input8.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input_part1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath2.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join4.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join5.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join6.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join7.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join8.q.xml /hive/trunk/ql/src/test/results/compiler/plan/sample1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf4.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf6.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf_case.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf_when.q.xml /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyArrayMapStruct.java
          Hide
          Thejas M Nair added a comment -

          Adding release note.

          Show
          Thejas M Nair added a comment - Adding release note.
          Hide
          Hudson added a comment -

          Integrated in Hive-trunk-hadoop2 #270 (See https://builds.apache.org/job/Hive-trunk-hadoop2/270/)
          HIVE-3253 : ArrayIndexOutOfBounds exception for deeply nested structs (Thejas Nair via Ashutosh Chauhan) (Revision 1499450)

          Result = FAILURE
          hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1499450
          Files :

          • /hive/trunk/data/files/nested_complex.txt
          • /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/TestLazyHBaseObject.java
          • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java
          • /hive/trunk/ql/src/test/queries/clientnegative/nested_complex_neg.q
          • /hive/trunk/ql/src/test/queries/clientpositive/nested_complex.q
          • /hive/trunk/ql/src/test/results/clientnegative/nested_complex_neg.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/alter_partition_coltype.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_4.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin10.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin11.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin12.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin13.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/columnstats_partlvl.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/columnstats_tbllvl.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/combine2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/combine2_hadoop20.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/filter_join_breaktask.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input23.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input42.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input_part7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/input_part9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/join_filters_overlap.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_12.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_13.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_4.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/louter_join_ppr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/macro.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/metadataonly1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/nested_complex.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/outer_join_ppr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/ppd_join_filter.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/regexp_extract.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/router_join_ppr.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample10.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample8.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sample9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin9.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_15.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/transform_ppr1.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/transform_ppr2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_explode.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_java_method.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_reflect.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udf_reflect2.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/udtf_explode.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/union24.q.out
          • /hive/trunk/ql/src/test/results/clientpositive/union_ppr.q.out
          • /hive/trunk/ql/src/test/results/compiler/plan/cast1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby2.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby3.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby4.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby5.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/groupby6.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input20.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input8.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input_part1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath2.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join4.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join5.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join6.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join7.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/join8.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/sample1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf1.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf4.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf6.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf_case.q.xml
          • /hive/trunk/ql/src/test/results/compiler/plan/udf_when.q.xml
          • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java
          • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java
          • /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java
          • /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyArrayMapStruct.java
          Show
          Hudson added a comment - Integrated in Hive-trunk-hadoop2 #270 (See https://builds.apache.org/job/Hive-trunk-hadoop2/270/ ) HIVE-3253 : ArrayIndexOutOfBounds exception for deeply nested structs (Thejas Nair via Ashutosh Chauhan) (Revision 1499450) Result = FAILURE hashutosh : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1499450 Files : /hive/trunk/data/files/nested_complex.txt /hive/trunk/hbase-handler/src/test/org/apache/hadoop/hive/hbase/TestLazyHBaseObject.java /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/plan/PlanUtils.java /hive/trunk/ql/src/test/queries/clientnegative/nested_complex_neg.q /hive/trunk/ql/src/test/queries/clientpositive/nested_complex.q /hive/trunk/ql/src/test/results/clientnegative/nested_complex_neg.q.out /hive/trunk/ql/src/test/results/clientpositive/alter_partition_coltype.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_1.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_11.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_12.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_2.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_3.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_4.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_5.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_7.q.out /hive/trunk/ql/src/test/results/clientpositive/auto_sortmerge_join_8.q.out /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_1.q.out /hive/trunk/ql/src/test/results/clientpositive/bucket_map_join_2.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_1.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_2.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_3.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_4.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_5.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_6.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_7.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketcontext_8.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin1.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin10.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin11.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin12.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin13.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin7.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin8.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin9.q.out /hive/trunk/ql/src/test/results/clientpositive/bucketmapjoin_negative3.q.out /hive/trunk/ql/src/test/results/clientpositive/columnstats_partlvl.q.out /hive/trunk/ql/src/test/results/clientpositive/columnstats_tbllvl.q.out /hive/trunk/ql/src/test/results/clientpositive/combine2.q.out /hive/trunk/ql/src/test/results/clientpositive/combine2_hadoop20.q.out /hive/trunk/ql/src/test/results/clientpositive/filter_join_breaktask.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_1.q.out /hive/trunk/ql/src/test/results/clientpositive/groupby_sort_skew_1.q.out /hive/trunk/ql/src/test/results/clientpositive/input23.q.out /hive/trunk/ql/src/test/results/clientpositive/input42.q.out /hive/trunk/ql/src/test/results/clientpositive/input_part7.q.out /hive/trunk/ql/src/test/results/clientpositive/input_part9.q.out /hive/trunk/ql/src/test/results/clientpositive/join_filters_overlap.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_1.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_11.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_12.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_13.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_2.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_3.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_4.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_5.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_6.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_7.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_8.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_dml_9.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_1.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_2.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_multiskew_3.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_1.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_2.q.out /hive/trunk/ql/src/test/results/clientpositive/list_bucket_query_oneskew_3.q.out /hive/trunk/ql/src/test/results/clientpositive/louter_join_ppr.q.out /hive/trunk/ql/src/test/results/clientpositive/macro.q.out /hive/trunk/ql/src/test/results/clientpositive/metadataonly1.q.out /hive/trunk/ql/src/test/results/clientpositive/nested_complex.q.out /hive/trunk/ql/src/test/results/clientpositive/outer_join_ppr.q.out /hive/trunk/ql/src/test/results/clientpositive/pcr.q.out /hive/trunk/ql/src/test/results/clientpositive/ppd_join_filter.q.out /hive/trunk/ql/src/test/results/clientpositive/ppd_union_view.q.out /hive/trunk/ql/src/test/results/clientpositive/ppr_allchildsarenull.q.out /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner1.q.out /hive/trunk/ql/src/test/results/clientpositive/rand_partitionpruner3.q.out /hive/trunk/ql/src/test/results/clientpositive/regexp_extract.q.out /hive/trunk/ql/src/test/results/clientpositive/router_join_ppr.q.out /hive/trunk/ql/src/test/results/clientpositive/sample10.q.out /hive/trunk/ql/src/test/results/clientpositive/sample6.q.out /hive/trunk/ql/src/test/results/clientpositive/sample8.q.out /hive/trunk/ql/src/test/results/clientpositive/sample9.q.out /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin9.q.out /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_13.q.out /hive/trunk/ql/src/test/results/clientpositive/smb_mapjoin_15.q.out /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_5.q.out /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_6.q.out /hive/trunk/ql/src/test/results/clientpositive/sort_merge_join_desc_7.q.out /hive/trunk/ql/src/test/results/clientpositive/transform_ppr1.q.out /hive/trunk/ql/src/test/results/clientpositive/transform_ppr2.q.out /hive/trunk/ql/src/test/results/clientpositive/truncate_column_list_bucket.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_explode.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_java_method.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_reflect.q.out /hive/trunk/ql/src/test/results/clientpositive/udf_reflect2.q.out /hive/trunk/ql/src/test/results/clientpositive/udtf_explode.q.out /hive/trunk/ql/src/test/results/clientpositive/union24.q.out /hive/trunk/ql/src/test/results/clientpositive/union_ppr.q.out /hive/trunk/ql/src/test/results/compiler/plan/cast1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby2.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby3.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby4.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby5.q.xml /hive/trunk/ql/src/test/results/compiler/plan/groupby6.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input20.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input8.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input_part1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath.q.xml /hive/trunk/ql/src/test/results/compiler/plan/input_testxpath2.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join4.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join5.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join6.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join7.q.xml /hive/trunk/ql/src/test/results/compiler/plan/join8.q.xml /hive/trunk/ql/src/test/results/compiler/plan/sample1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf1.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf4.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf6.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf_case.q.xml /hive/trunk/ql/src/test/results/compiler/plan/udf_when.q.xml /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyFactory.java /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazySimpleSerDe.java /hive/trunk/serde/src/java/org/apache/hadoop/hive/serde2/lazy/LazyUtils.java /hive/trunk/serde/src/test/org/apache/hadoop/hive/serde2/lazy/TestLazyArrayMapStruct.java
          Hide
          Ashutosh Chauhan added a comment -

          This issue has been fixed and released as part of 0.12 release. If you find further issues, please create a new jira and link it to this one.

          Show
          Ashutosh Chauhan added a comment - This issue has been fixed and released as part of 0.12 release. If you find further issues, please create a new jira and link it to this one.

            People

            • Assignee:
              Thejas M Nair
              Reporter:
              Swarnim Kulkarni
            • Votes:
              2 Vote for this issue
              Watchers:
              12 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved:

                Development