Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-8607 Java 8 support for Hive
  3. HIVE-9193

Fix ordering differences due to Java 8 (Part 3)

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • Tests
    • None

    Description

      This patch fixes following q-test failures in Java 8:

      (1) avro_* q-tests with map data type.

      Select operator uses LazySimpleSerDe/StandMapObjectInspector, which is used all over for serializing results back to the end user for queries with maps. To avoid adding the additional memory cost associated with LinkedHashMap, we generate java version specific out files for these tests.

      (2) plan_json.q, join0.q, input4.q, authorization_explain.q

      EXPLAIN FORMATTED outputs string representation of JSONObject, which internally is a HashMap. Again, we generate java version specific out files for these tests.

      (3) explain_dependency.q

      EXPLAIN DEPENDENCY outputs string representation of ReadEntity.parents. Changed that to an ordered map.

      (4) list_bucket_dml_6.q

      DESC FORMATTED calls StorageDescriptor.getSkewedInfo() HMS API, which returns a thrift (unordered) map. Generate java version specific out file for this test.

      Attachments

        1. HIVE-9193.patch
          309 kB
          Mohit Sabharwal
        2. HIVE-9193.1.patch
          308 kB
          Mohit Sabharwal
        3. HIVE-9193.2.patch
          331 kB
          Mohit Sabharwal

        Issue Links

          Activity

            People

              mohitsabharwal Mohit Sabharwal
              mohitsabharwal Mohit Sabharwal
              Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: