Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8607 Java 8 support for Hive
  3. HIVE-9239

Fix ordering differences due to Java 8 (Part 5)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • Tests
    • None

    Description

      This patch fixes the following tests:

      (1) TestCliDriver.testCliDriver_column_access_stats

      Converted all maps used to populate ColumnAccessInfo.tableToColumnAccessMap to deterministic order maps. These include ParseContext.topToTable and relevant maps in UpdateDeleteSemanticAnalyzer.

      (2) TestCliDriver.testCliDriver_table_access_keys_stats

      CheckTableAccessHook prints table access key information from TableAccessInfo by operator. Made the relevant maps deterministic.

      (3) TestCliDriver.testCliDriver_subquery_multiinsert

      Tasks are printed in different order in ExplainTask in Java 8 vs Java 7. TaskCompiler, specifically MapReduceCompiler should use deterministic map for GenMRProcContext.opTaskMap

      (4) TestCliDriver: outer_join_ppr.q and subquery_notin_having.q

      Predicate ExprNodeDesc has children in different order. This ordering looks to be coming from antlr. Generated version specific output for these.

      (5) TestCliDriver.testCliDriver_parquet_map_null

      Avro API uses HashMap for deserialized map, which makes input to Parquet non-deterministic. Generated version specific output.

      Attachments

        1. HIVE-9239.patch
          233 kB
          Mohit Sabharwal

        Issue Links

          Activity

            People

              mohitsabharwal Mohit Sabharwal
              mohitsabharwal Mohit Sabharwal
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: