Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8607 Java 8 support for Hive
  3. HIVE-9239

Fix ordering differences due to Java 8 (Part 5)

Log workAgile BoardRank to TopRank to BottomBulk Copy AttachmentsBulk Move AttachmentsVotersWatch issueWatchersConvert to IssueMoveLinkCloneLabelsUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • Tests
    • None

    Description

      This patch fixes the following tests:

      (1) TestCliDriver.testCliDriver_column_access_stats

      Converted all maps used to populate ColumnAccessInfo.tableToColumnAccessMap to deterministic order maps. These include ParseContext.topToTable and relevant maps in UpdateDeleteSemanticAnalyzer.

      (2) TestCliDriver.testCliDriver_table_access_keys_stats

      CheckTableAccessHook prints table access key information from TableAccessInfo by operator. Made the relevant maps deterministic.

      (3) TestCliDriver.testCliDriver_subquery_multiinsert

      Tasks are printed in different order in ExplainTask in Java 8 vs Java 7. TaskCompiler, specifically MapReduceCompiler should use deterministic map for GenMRProcContext.opTaskMap

      (4) TestCliDriver: outer_join_ppr.q and subquery_notin_having.q

      Predicate ExprNodeDesc has children in different order. This ordering looks to be coming from antlr. Generated version specific output for these.

      (5) TestCliDriver.testCliDriver_parquet_map_null

      Avro API uses HashMap for deserialized map, which makes input to Parquet non-deterministic. Generated version specific output.

      Attachments

        1. HIVE-9239.patch
          233 kB
          Mohit Sabharwal

        Activity

          This comment will be Viewable by All Users Viewable by All Users
          Cancel

          People

            mohitsabharwal Mohit Sabharwal Assign to me
            mohitsabharwal Mohit Sabharwal
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved:

              Slack

                Issue deployment