Hive
  1. Hive
  2. HIVE-6410

Allow output serializations separators to be set for HDFS path as well.

    Details

    • Type: Improvement Improvement
    • Status: Patch Available
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: 0.13.0
    • Component/s: Query Processor
    • Labels:
      None

      Description

      HIVE-3682 adds functionality for users to set serialization constants for 'insert overwrite local directory'. The same functionality should be available for hdfs path as well. The workaround suggested is to create a table with required format and insert into the table, which enforces the users to know the schema of the result and create the table ahead. Though that works, it is good to have the functionality for loading into directory as well.

      I'm planning to add the same functionality in 'insert overwrite directory' in this jira.

      1. HIVE-6410.patch
        43 kB
        Amareshwari Sriramadasu

        Issue Links

          Activity

          Hide
          Hive QA added a comment -

          Overall: -1 at least one tests failed

          Here are the results of testing the latest attachment:
          https://issues.apache.org/jira/secure/attachment/12628684/HIVE-6410.patch

          ERROR: -1 due to 1 failed/errored test(s), 5556 tests executed
          Failed tests:

          org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_overwrite_directory
          

          Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2192/testReport
          Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2192/console

          Messages:

          Executing org.apache.hive.ptest.execution.PrepPhase
          Executing org.apache.hive.ptest.execution.ExecutionPhase
          Executing org.apache.hive.ptest.execution.ReportingPhase
          Tests exited with: TestsFailedException: 1 tests failed
          

          This message is automatically generated.

          ATTACHMENT ID: 12628684

          Show
          Hive QA added a comment - Overall : -1 at least one tests failed Here are the results of testing the latest attachment: https://issues.apache.org/jira/secure/attachment/12628684/HIVE-6410.patch ERROR: -1 due to 1 failed/errored test(s), 5556 tests executed Failed tests: org.apache.hadoop.hive.cli.TestCliDriver.testCliDriver_insert_overwrite_directory Test results: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2192/testReport Console output: http://bigtop01.cloudera.org:8080/job/PreCommit-HIVE-Build/2192/console Messages: Executing org.apache.hive.ptest.execution.PrepPhase Executing org.apache.hive.ptest.execution.ExecutionPhase Executing org.apache.hive.ptest.execution.ReportingPhase Tests exited with: TestsFailedException: 1 tests failed This message is automatically generated. ATTACHMENT ID: 12628684
          Hide
          Xuefu Zhang added a comment -

          Though closing either one of the dupes is fine, HIVE-5672 has the history of discussions, which provides background for code reviewers.

          Show
          Xuefu Zhang added a comment - Though closing either one of the dupes is fine, HIVE-5672 has the history of discussions, which provides background for code reviewers.
          Hide
          Amareshwari Sriramadasu added a comment -

          Resubmitting for tests to run

          Show
          Amareshwari Sriramadasu added a comment - Resubmitting for tests to run
          Hide
          Amareshwari Sriramadasu added a comment -

          Xuefu Wang, had the patch ready, so uploaded. I don't mind any of them being closed as duplicate of other, as long as code gets in.

          Show
          Amareshwari Sriramadasu added a comment - Xuefu Wang , had the patch ready, so uploaded. I don't mind any of them being closed as duplicate of other, as long as code gets in.
          Hide
          Amareshwari Sriramadasu added a comment -

          Attaching the patch with fix. The changes include :

          • Grammar changes for accepting table format and row format for 'insert overwrite directory'.
          • Fixed existing code to accept serde properties as well.
          • Added insert_overwrite_directory.q

          Review board request - https://reviews.apache.org/r/18060/

          Show
          Amareshwari Sriramadasu added a comment - Attaching the patch with fix. The changes include : Grammar changes for accepting table format and row format for 'insert overwrite directory'. Fixed existing code to accept serde properties as well. Added insert_overwrite_directory.q Review board request - https://reviews.apache.org/r/18060/
          Hide
          Xuefu Zhang added a comment -

          Obviously, this is a dupe of https://issues.apache.org/jira/browse/HIVE-5672. Please close this one and take HIVE-5672 instead. Thanks.

          Show
          Xuefu Zhang added a comment - Obviously, this is a dupe of https://issues.apache.org/jira/browse/HIVE-5672 . Please close this one and take HIVE-5672 instead. Thanks.

            People

            • Assignee:
              Amareshwari Sriramadasu
              Reporter:
              Amareshwari Sriramadasu
            • Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

              • Created:
                Updated:

                Development