Hive
  1. Hive
  2. HIVE-3486

CTAS in database with location on non-default name node fails

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.10.0
    • Fix Version/s: 0.10.0
    • Component/s: Query Processor
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      If a database has a location which is on a different name node than the default database's location, CTAS queries run in that database will fail.

      This is because the intermediate location which is where the final FileSinkOperator writes to is determined based on the scheme and authority of the value of hive.metastore.warehouse.dir instead of the table's database's location.

      1. HIVE-3486.2.patch.txt
        9 kB
        Kevin Wilfong
      2. HIVE-3486.1.patch.txt
        8 kB
        Kevin Wilfong

        Activity

        Show
        Kevin Wilfong added a comment - https://reviews.facebook.net/D5553
        Hide
        Namit Jain added a comment -

        comments on phabricator

        Show
        Namit Jain added a comment - comments on phabricator
        Hide
        Kevin Wilfong added a comment -

        Updated per Namit's comment.

        Show
        Kevin Wilfong added a comment - Updated per Namit's comment.
        Hide
        Namit Jain added a comment -

        Committed. Thanks Kevin

        Show
        Namit Jain added a comment - Committed. Thanks Kevin
        Hide
        Hudson added a comment -

        Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/)
        HIVE-3486 CTAS in database with location on non-default name node fails
        (Kevin Wilfong via namit) (Revision 1387850)

        Result = ABORTED
        namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1387850
        Files :

        • /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java
        • /hive/trunk/ql/src/test/queries/clientpositive/ctas_uses_database_location.q
        • /hive/trunk/ql/src/test/results/clientpositive/ctas_uses_database_location.q.out
        Show
        Hudson added a comment - Integrated in Hive-trunk-hadoop2 #54 (See https://builds.apache.org/job/Hive-trunk-hadoop2/54/ ) HIVE-3486 CTAS in database with location on non-default name node fails (Kevin Wilfong via namit) (Revision 1387850) Result = ABORTED namit : http://svn.apache.org/viewcvs.cgi/?root=Apache-SVN&view=rev&rev=1387850 Files : /hive/trunk/ql/src/java/org/apache/hadoop/hive/ql/parse/SemanticAnalyzer.java /hive/trunk/ql/src/test/queries/clientpositive/ctas_uses_database_location.q /hive/trunk/ql/src/test/results/clientpositive/ctas_uses_database_location.q.out
        Hide
        Ashutosh Chauhan added a comment -

        This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

        Show
        Ashutosh Chauhan added a comment - This issue is fixed and released as part of 0.10.0 release. If you find an issue which seems to be related to this one, please create a new jira and link this one with new jira.

          People

          • Assignee:
            Kevin Wilfong
            Reporter:
            Kevin Wilfong
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development