Hive
  1. Hive
  2. HIVE-6091

Empty pipeout files are created for connection create/close

    Details

    • Type: Bug Bug
    • Status: Patch Available
    • Priority: Minor Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.2.0, 1.2.1
    • Fix Version/s: None
    • Component/s: None
    • Labels:
      None

      Description

      Pipeout files are created when a connection is established and removed only when data was produced. Instead we should create them only when data has to be fetched or remove them whether data is fetched or not.

      1. HIVE-6091.patch
        1 kB
        Thiruvel Thirumoolan
      2. HIVE-6091.1.patch
        0.6 kB
        Bing Li

        Activity

        Hide
        Hive QA added a comment -

        Overall: -1 at least one tests failed

        Here are the results of testing the latest attachment:
        https://issues.apache.org/jira/secure/attachment/12745185/HIVE-6091.1.patch

        ERROR: -1 due to 1 failed/errored test(s), 9190 tests executed
        Failed tests:

        org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbort
        

        Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4605/testReport
        Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4605/console
        Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4605/

        Messages:

        Executing org.apache.hive.ptest.execution.PrepPhase
        Executing org.apache.hive.ptest.execution.ExecutionPhase
        Executing org.apache.hive.ptest.execution.ReportingPhase
        Tests exited with: TestsFailedException: 1 tests failed
        

        This message is automatically generated.

        ATTACHMENT ID: 12745185 - PreCommit-HIVE-TRUNK-Build

        Show
        Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12745185/HIVE-6091.1.patch ERROR: -1 due to 1 failed/errored test(s), 9190 tests executed Failed tests: org.apache.hive.hcatalog.streaming.TestStreaming.testTransactionBatchAbort Test results: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4605/testReport Console output: http://ec2-174-129-184-35.compute-1.amazonaws.com/jenkins/job/PreCommit-HIVE-TRUNK-Build/4605/console Test logs: http://ec2-174-129-184-35.compute-1.amazonaws.com/logs/PreCommit-HIVE-TRUNK-Build-4605/ Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12745185 - PreCommit-HIVE-TRUNK-Build
        Hide
        Bing Li added a comment -

        The patch is created based on the latest code

        Show
        Bing Li added a comment - The patch is created based on the latest code
        Hide
        Bing Li added a comment -

        With this patch, the pipeout file could be deleted after the session closed.
        I have tested it based on Hive 1.2.1

        Show
        Bing Li added a comment - With this patch, the pipeout file could be deleted after the session closed. I have tested it based on Hive 1.2.1
        Hide
        Bing Li added a comment -

        Seems that the patch has been merged into Hive from 0.13.0 via https://issues.apache.org/jira/browse/HIVE-4395

        Show
        Bing Li added a comment - Seems that the patch has been merged into Hive from 0.13.0 via https://issues.apache.org/jira/browse/HIVE-4395
        Hide
        Thiruvel Thirumoolan added a comment -

        Starting off with a simple approach, to delete the file on connection close.

        Show
        Thiruvel Thirumoolan added a comment - Starting off with a simple approach, to delete the file on connection close.

          People

          • Assignee:
            Thiruvel Thirumoolan
            Reporter:
            Thiruvel Thirumoolan
          • Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Created:
              Updated:

              Development