Hive
  1. Hive
  2. HIVE-6263

Avoid sending input files multiple times on Tez

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: None
    • Labels:
      None

      Description

      Input paths can be recontructed from the plan. No need to send them in the job conf as well.

      1. HIVE-6263.1.patch
        7 kB
        Gunther Hagleitner
      2. HIVE-6263.2.patch
        7 kB
        Gunther Hagleitner
      3. HIVE-6263.3.patch
        7 kB
        Gunther Hagleitner

        Activity

        Hide
        Gunther Hagleitner added a comment -

        Committed to trunk. Thanks for the review Vikram!

        Show
        Gunther Hagleitner added a comment - Committed to trunk. Thanks for the review Vikram!
        Hide
        Gunther Hagleitner added a comment -

        Test failures are unrelated.

        Show
        Gunther Hagleitner added a comment - Test failures are unrelated.
        Hide
        Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12624934/HIVE-6263.3.patch

        ERROR: -1 due to 7 failed/errored test(s), 4949 tests executed
        Failed tests:

        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_filter
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_groupby
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_join
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_part
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_select
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_table
        org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_union
        

        Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1007/testReport
        Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1007/console

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 7 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12624934

        Show
        Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12624934/HIVE-6263.3.patch ERROR: -1 due to 7 failed/errored test(s), 4949 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_filter org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_groupby org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_join org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_part org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_select org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_table org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_annotate_stats_union Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1007/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/1007/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 7 tests failed This message is automatically generated. ATTACHMENT ID: 12624934
        Hide
        Vikram Dixit K added a comment -

        LGTM +1 (assuming tests pass).

        Show
        Vikram Dixit K added a comment - LGTM +1 (assuming tests pass).
        Hide
        Gunther Hagleitner added a comment -

        Third time's the charm.

        Show
        Gunther Hagleitner added a comment - Third time's the charm.
        Hide
        Gunther Hagleitner added a comment -

        Re-uploading to trigger precommit.

        Show
        Gunther Hagleitner added a comment - Re-uploading to trigger precommit.

          People

          • Assignee:
            Gunther Hagleitner
            Reporter:
            Gunther Hagleitner
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development