Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7042

Fix stats_partscan_1_23.q and orc_createas1.q for hadoop-2

    Details

    • Type: Bug
    • Status: Closed
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 0.14.0
    • Fix Version/s: 0.14.0
    • Component/s: None
    • Labels:
      None

      Description

      stats_partscan_1_23.q and orc_createas1.q should use HiveInputFormat as opposed to CombineHiveInputFormat. RCFile uses DefaultCodec for compression (uses DEFLATE) which is not splittable. Hence using CombineHiveIF will yield different results for these tests. ORC should use HiveIF to generate ORC splits.

      1. HIVE-7042.1.patch
        4 kB
        Prasanth Jayachandran
      2. HIVE-7042.1.patch.txt
        4 kB
        Prasanth Jayachandran

        Activity

        Hide
        thejas Thejas M Nair added a comment -

        This has been fixed in 0.14 release. Please open new jira if you see any issues.

        Show
        thejas Thejas M Nair added a comment - This has been fixed in 0.14 release. Please open new jira if you see any issues.
        Hide
        prasanth_j Prasanth Jayachandran added a comment -

        Thanks Ashutosh!

        Show
        prasanth_j Prasanth Jayachandran added a comment - Thanks Ashutosh!
        Hide
        ashutoshc Ashutosh Chauhan added a comment -

        Tested this manually on mac os & on ubuntu. Results are consistent. Committed to trunk. Thanks, Prasanth!

        Show
        ashutoshc Ashutosh Chauhan added a comment - Tested this manually on mac os & on ubuntu. Results are consistent. Committed to trunk. Thanks, Prasanth!
        Hide
        prasanth_j Prasanth Jayachandran added a comment -

        Not sure why this patch was not picked up HIVE QA for days. Reuploading the patch again.

        Show
        prasanth_j Prasanth Jayachandran added a comment - Not sure why this patch was not picked up HIVE QA for days. Reuploading the patch again.
        Hide
        prasanth_j Prasanth Jayachandran added a comment -

        Ashutosh Chauhan Yes. I tested it with mac and linux, the results are consistent.

        Show
        prasanth_j Prasanth Jayachandran added a comment - Ashutosh Chauhan Yes. I tested it with mac and linux, the results are consistent.
        Hide
        ashutoshc Ashutosh Chauhan added a comment -

        Thanks Prasanth Jayachandran for taking this up. I assume you have tested this on both mac & linux. +1

        Show
        ashutoshc Ashutosh Chauhan added a comment - Thanks Prasanth Jayachandran for taking this up. I assume you have tested this on both mac & linux. +1
        Hide
        prasanth_j Prasanth Jayachandran added a comment -

        Ashutosh Chauhan can you take a look at this patch?

        Show
        prasanth_j Prasanth Jayachandran added a comment - Ashutosh Chauhan can you take a look at this patch?

          People

          • Assignee:
            prasanth_j Prasanth Jayachandran
            Reporter:
            prasanth_j Prasanth Jayachandran
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development