Hive
  1. Hive
  2. HIVE-7042

Fix stats_partscan_1_23.q and orc_createas1.q for hadoop-2

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      stats_partscan_1_23.q and orc_createas1.q should use HiveInputFormat as opposed to CombineHiveInputFormat. RCFile uses DefaultCodec for compression (uses DEFLATE) which is not splittable. Hence using CombineHiveIF will yield different results for these tests. ORC should use HiveIF to generate ORC splits.

      1. HIVE-7042.1.patch
        4 kB
        Prasanth Jayachandran
      2. HIVE-7042.1.patch.txt
        4 kB
        Prasanth Jayachandran

        Activity

        Hide
        Prasanth Jayachandran added a comment -

        Ashutosh Chauhan can you take a look at this patch?

        Show
        Prasanth Jayachandran added a comment - Ashutosh Chauhan can you take a look at this patch?
        Hide
        Ashutosh Chauhan added a comment -

        Thanks Prasanth Jayachandran for taking this up. I assume you have tested this on both mac & linux. +1

        Show
        Ashutosh Chauhan added a comment - Thanks Prasanth Jayachandran for taking this up. I assume you have tested this on both mac & linux. +1
        Hide
        Prasanth Jayachandran added a comment -

        Ashutosh Chauhan Yes. I tested it with mac and linux, the results are consistent.

        Show
        Prasanth Jayachandran added a comment - Ashutosh Chauhan Yes. I tested it with mac and linux, the results are consistent.
        Hide
        Prasanth Jayachandran added a comment -

        Not sure why this patch was not picked up HIVE QA for days. Reuploading the patch again.

        Show
        Prasanth Jayachandran added a comment - Not sure why this patch was not picked up HIVE QA for days. Reuploading the patch again.
        Hide
        Ashutosh Chauhan added a comment -

        Tested this manually on mac os & on ubuntu. Results are consistent. Committed to trunk. Thanks, Prasanth!

        Show
        Ashutosh Chauhan added a comment - Tested this manually on mac os & on ubuntu. Results are consistent. Committed to trunk. Thanks, Prasanth!
        Hide
        Prasanth Jayachandran added a comment -

        Thanks Ashutosh!

        Show
        Prasanth Jayachandran added a comment - Thanks Ashutosh!
        Hide
        Thejas M Nair added a comment -

        This has been fixed in 0.14 release. Please open new jira if you see any issues.

        Show
        Thejas M Nair added a comment - This has been fixed in 0.14 release. Please open new jira if you see any issues.

          People

          • Assignee:
            Prasanth Jayachandran
            Reporter:
            Prasanth Jayachandran
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development