Details

    • Type: New Feature New Feature
    • Status: Open
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 0.9.1, 0.10.0, 0.11.0
    • Fix Version/s: 0.10.1
    • Labels:
      None
    • Release Note:
      Hide
      This development is rather a POC using UDTF hive function but it works !,
      I will focus on removing the need to the DUAL table and improve the implementation
      Show
      This development is rather a POC using UDTF hive function but it works !, I will focus on removing the need to the DUAL table and improve the implementation

      Description

      I am thinking about something like :

      SELECT jdbcload('driver','url','user','password','sql') FROM dual; (https://issues.apache.org/jira/browse/HIVE-1558)

      There is already a JIRA https://issues.apache.org/jira/browse/HIVE-1555 for JDBCStorageHandler

      1. patchfile
        7 kB
        Maxime LANCIAUX

        Activity

        Hide
        Lianhui Wang added a comment -

        i think that must support as clause like transform syntax.
        for example:
        SELECT jdbcload('driver','url','user','password','sql') as c1,c2 FROM dual;

        Show
        Lianhui Wang added a comment - i think that must support as clause like transform syntax. for example: SELECT jdbcload('driver','url','user','password','sql') as c1,c2 FROM dual;
        Hide
        Mark Grover added a comment -

        Maxime, can you upload a patch and post it for review.

        Also, out of curiosity, when would a user use this instead of using something like Apache Sqoop.

        Show
        Mark Grover added a comment - Maxime, can you upload a patch and post it for review. Also, out of curiosity, when would a user use this instead of using something like Apache Sqoop.
        Hide
        Maxime LANCIAUX added a comment -

        This development is rather a POC using UDTF hive function but it works !,
        I will focus on removing the need to the DUAL table and improve the implementation

        Show
        Maxime LANCIAUX added a comment - This development is rather a POC using UDTF hive function but it works !, I will focus on removing the need to the DUAL table and improve the implementation
        Hide
        Maxime LANCIAUX added a comment -

        BI users will like this function because they are using Hive from Tableau or SAS (or other tools) and they don't want to exit their software and use a command ligne tool to load a little amount of data. (even if sqoop is a great tool)

        Show
        Maxime LANCIAUX added a comment - BI users will like this function because they are using Hive from Tableau or SAS (or other tools) and they don't want to exit their software and use a command ligne tool to load a little amount of data. (even if sqoop is a great tool)
        Hide
        Mark Grover added a comment -

        Thanks Maxime. Can you also please post the patch on reviewboard (or Phabricator) as well?

        Show
        Mark Grover added a comment - Thanks Maxime. Can you also please post the patch on reviewboard (or Phabricator) as well?
        Show
        Maxime LANCIAUX added a comment - Of course, https://reviews.apache.org/r/9875/ and https://reviews.facebook.net/D9321
        Hide
        Maxime LANCIAUX added a comment -

        I will work on improving the implementation soon so I am looking for any advice (especially how to remove the need to the DUAL table) ! Thanks.

        Show
        Maxime LANCIAUX added a comment - I will work on improving the implementation soon so I am looking for any advice (especially how to remove the need to the DUAL table) ! Thanks.

          People

          • Assignee:
            Unassigned
            Reporter:
            Maxime LANCIAUX
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:

              Development