Details

    • Type: New Feature New Feature
    • Status: Patch Available
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.9.1, 0.10.0, 0.11.0
    • Fix Version/s: 0.10.1
    • Labels:
      None
    • Release Note:
      Hide
      This development is rather a POC using UDTF hive function but it works !,
      I will focus on removing the need to the DUAL table and improve the implementation
      Show
      This development is rather a POC using UDTF hive function but it works !, I will focus on removing the need to the DUAL table and improve the implementation

      Description

      I am thinking about something like :

      SELECT jdbcload('driver','url','user','password','sql') FROM dual; (https://issues.apache.org/jira/browse/HIVE-1558)

      There is already a JIRA https://issues.apache.org/jira/browse/HIVE-1555 for JDBCStorageHandler

      1. patchfile
        7 kB
        Maxime LANCIAUX

        Activity

        Maxime LANCIAUX created issue -
        Maxime LANCIAUX made changes -
        Field Original Value New Value
        Affects Version/s 0.10.0 [ 12320745 ]
        Summary Allow Hive to get connect to RDBMS Allow Hive to connect to RDBMS
        Affects Version/s 0.9.1 [ 12320943 ]
        Component/s Import/Export [ 12317307 ]
        Component/s JDBC [ 12314178 ]
        Component/s SQL [ 12315100 ]
        Component/s StorageHandler [ 12317302 ]
        Maxime LANCIAUX made changes -
        Description I am thinking about something like :

        CREATE JDBCEXTERNAL TABLE (
         col1 int,
         col2 string
        )
        TBLPROPERTIES ...

        and/or

        SELECT jdbcload('driver','url','user','password','sql') FROM dual;
        Maxime LANCIAUX made changes -
        Description I am thinking about something like :

        CREATE JDBCEXTERNAL TABLE (
         col1 int,
         col2 string
        )
        TBLPROPERTIES ...

        and/or

        SELECT jdbcload('driver','url','user','password','sql') FROM dual;
        I am thinking about something like :

        SELECT jdbcload('driver','url','user','password','sql') FROM dual;

        There is already a JIRA https://issues.apache.org/jira/browse/HIVE-1555 for JDBCStorageHandler
        Maxime LANCIAUX made changes -
        Affects Version/s 0.9.0 [ 12317742 ]
        Affects Version/s 0.11.0 [ 12323587 ]
        Hide
        Lianhui Wang added a comment -

        i think that must support as clause like transform syntax.
        for example:
        SELECT jdbcload('driver','url','user','password','sql') as c1,c2 FROM dual;

        Show
        Lianhui Wang added a comment - i think that must support as clause like transform syntax. for example: SELECT jdbcload('driver','url','user','password','sql') as c1,c2 FROM dual;
        Hide
        Mark Grover added a comment -

        Maxime, can you upload a patch and post it for review.

        Also, out of curiosity, when would a user use this instead of using something like Apache Sqoop.

        Show
        Mark Grover added a comment - Maxime, can you upload a patch and post it for review. Also, out of curiosity, when would a user use this instead of using something like Apache Sqoop.
        Maxime LANCIAUX made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note First implementation using UDTF Hive and JDBC
        Fix Version/s 0.9.1 [ 12320943 ]
        Fix Version/s 0.10.1 [ 12324018 ]
        Maxime LANCIAUX made changes -
        Status Patch Available [ 10002 ] Open [ 1 ]
        Affects Version/s 0.9.0 [ 12317742 ]
        Fix Version/s 0.9.1 [ 12320943 ]
        Hide
        Maxime LANCIAUX added a comment -

        This development is rather a POC using UDTF hive function but it works !,
        I will focus on removing the need to the DUAL table and improve the implementation

        Show
        Maxime LANCIAUX added a comment - This development is rather a POC using UDTF hive function but it works !, I will focus on removing the need to the DUAL table and improve the implementation
        Maxime LANCIAUX made changes -
        Attachment patchfile [ 12573111 ]
        Maxime LANCIAUX made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Release Note First implementation using UDTF Hive and JDBC This development is rather a POC using UDTF hive function but it works !,
        I will focus on removing the need to the DUAL table and improve the implementation
        Hide
        Maxime LANCIAUX added a comment -

        BI users will like this function because they are using Hive from Tableau or SAS (or other tools) and they don't want to exit their software and use a command ligne tool to load a little amount of data. (even if sqoop is a great tool)

        Show
        Maxime LANCIAUX added a comment - BI users will like this function because they are using Hive from Tableau or SAS (or other tools) and they don't want to exit their software and use a command ligne tool to load a little amount of data. (even if sqoop is a great tool)
        Hide
        Mark Grover added a comment -

        Thanks Maxime. Can you also please post the patch on reviewboard (or Phabricator) as well?

        Show
        Mark Grover added a comment - Thanks Maxime. Can you also please post the patch on reviewboard (or Phabricator) as well?
        Show
        Maxime LANCIAUX added a comment - Of course, https://reviews.apache.org/r/9875/ and https://reviews.facebook.net/D9321
        Hide
        Maxime LANCIAUX added a comment -

        I will work on improving the implementation soon so I am looking for any advice (especially how to remove the need to the DUAL table) ! Thanks.

        Show
        Maxime LANCIAUX added a comment - I will work on improving the implementation soon so I am looking for any advice (especially how to remove the need to the DUAL table) ! Thanks.
        Maxime LANCIAUX made changes -
        Description I am thinking about something like :

        SELECT jdbcload('driver','url','user','password','sql') FROM dual;

        There is already a JIRA https://issues.apache.org/jira/browse/HIVE-1555 for JDBCStorageHandler
        I am thinking about something like :

        SELECT jdbcload('driver','url','user','password','sql') FROM dual; (https://issues.apache.org/jira/browse/HIVE-1558)

        There is already a JIRA https://issues.apache.org/jira/browse/HIVE-1555 for JDBCStorageHandler

          People

          • Assignee:
            Unassigned
            Reporter:
            Maxime LANCIAUX
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development