Details

    • Type: New Feature
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: None
    • Fix Version/s: Future
    • Labels:
      None

      Description

      Create a storage plugin for elasticsearch

        Activity

        Hide
        __andrew Andrew added a comment -

        I have submitted a PR for an elasticsearch storage plugin at: https://github.com/apache/drill/pull/110.

        Show
        __andrew Andrew added a comment - I have submitted a PR for an elasticsearch storage plugin at: https://github.com/apache/drill/pull/110 .
        Hide
        dadoonet David Pilato added a comment -

        Apparently I'm getting a 404 error while trying to read the PR. Do I miss anything?

        Show
        dadoonet David Pilato added a comment - Apparently I'm getting a 404 error while trying to read the PR. Do I miss anything?
        Hide
        remcov Remco added a comment -

        I'd like to spent some time on working on the elasticsearch plugin (DRILL-3790), but cannot find the PR(https://github.com/apache/drill/pull/110) as well.

        Show
        remcov Remco added a comment - I'd like to spent some time on working on the elasticsearch plugin ( DRILL-3790 ), but cannot find the PR( https://github.com/apache/drill/pull/110 ) as well.
        Hide
        brucepenn Bruce Penn added a comment -

        I still get the 404. Has there been any work on this? If not, are there plans to start working on it?

        Show
        brucepenn Bruce Penn added a comment - I still get the 404. Has there been any work on this? If not, are there plans to start working on it?
        Hide
        JiffOrange Jonathan Westwood added a comment -

        We are interested in this addition @BDP and would be willing to put in time to help develop this feature. Any objections to us getting started? Thanks.

        Show
        JiffOrange Jonathan Westwood added a comment - We are interested in this addition @BDP and would be willing to put in time to help develop this feature. Any objections to us getting started? Thanks.
        Hide
        brucepenn Bruce Penn added a comment -

        If the question is directed at me, I have no objections in you starting work on this. I am not a developer anymore but have customers interested in this plugin.

        Show
        brucepenn Bruce Penn added a comment - If the question is directed at me, I have no objections in you starting work on this. I am not a developer anymore but have customers interested in this plugin.
        Hide
        JiffOrange Jonathan Westwood added a comment -

        Hi, it was not directed at anybody in particular, I just did not want to step on toes/waste our time if it was already being worked on. I guess, Andrew as the originator of the ticket should get sufficient time to object since he has likely already put in some effort. We will get started, can somebody assign the ticket? Thanks.

        Show
        JiffOrange Jonathan Westwood added a comment - Hi, it was not directed at anybody in particular, I just did not want to step on toes/waste our time if it was already being worked on. I guess, Andrew as the originator of the ticket should get sufficient time to object since he has likely already put in some effort. We will get started, can somebody assign the ticket? Thanks.
        Hide
        ebuildy Thomas Decaux added a comment -

        Hello,

        I am interesting by this too, currently we are exporting ES data to big JSON files to use it with Drill, it's just fabulous.

        But I am thinking this storage should be more "remote HTTP JSON data" storage, since JSON is quite standard (Facebook API, Youtube API ....), isnit?

        Any progress on this feature?

        Thanks,

        Show
        ebuildy Thomas Decaux added a comment - Hello, I am interesting by this too, currently we are exporting ES data to big JSON files to use it with Drill, it's just fabulous. But I am thinking this storage should be more "remote HTTP JSON data" storage, since JSON is quite standard (Facebook API, Youtube API ....), isnit? Any progress on this feature? Thanks,
        Hide
        Bpark Bo soon Park added a comment -

        Hello All,

        Do we have any progress about this feature ?

        Sincerely
        Bo.

        Show
        Bpark Bo soon Park added a comment - Hello All, Do we have any progress about this feature ? Sincerely Bo.
        Hide
        sarwar.bhuiyan@gmail.com Sarwar Bhuiyan added a comment -

        I see this pull request's comment has Elasticsearch in it https://github.com/apache/drill/pull/440 but I'm not seeing anything in the commits with Elasticsearch in it. Is that comment just a mistake?

        Show
        sarwar.bhuiyan@gmail.com Sarwar Bhuiyan added a comment - I see this pull request's comment has Elasticsearch in it https://github.com/apache/drill/pull/440 but I'm not seeing anything in the commits with Elasticsearch in it. Is that comment just a mistake?
        Hide
        cgivre Charles Givre added a comment -

        Hello all,
        I stumbled on this https://github.com/Anchormen/sql4es this evening and was wondering if this might be of use in integrating Drill with Elasticsearch. It is a mostly fully functional JDBC driver for Elasticsearch.

        Here's the description:
        Sql-for-Elasticsearch (sql4es) is a jdbc 4.1 driver for Elasticsearch 2.0 - 2.4 implementing the majority of the JDBC interfaces: Connection, Statement, PreparedStatment, ResultSet, Batch and DataBase- / ResultSetMetadata. The screenshot below shows SQLWorkbenchJ with a selection of SQL statements that can be executed using the driver. As of version 0.8.2.3 the driver supports Shield allowing the use of credentials and SSL.

        Show
        cgivre Charles Givre added a comment - Hello all, I stumbled on this https://github.com/Anchormen/sql4es this evening and was wondering if this might be of use in integrating Drill with Elasticsearch. It is a mostly fully functional JDBC driver for Elasticsearch. Here's the description: Sql-for-Elasticsearch (sql4es) is a jdbc 4.1 driver for Elasticsearch 2.0 - 2.4 implementing the majority of the JDBC interfaces: Connection, Statement, PreparedStatment, ResultSet, Batch and DataBase- / ResultSetMetadata. The screenshot below shows SQLWorkbenchJ with a selection of SQL statements that can be executed using the driver. As of version 0.8.2.3 the driver supports Shield allowing the use of credentials and SSL.
        Hide
        Kani Javier Canillas added a comment -

        Hi everyone, we are struggling with elasticSearch integration. Sql4es has started working on support for ES 5.X, but from our tests it still doesn't cover attributes being list or object types.
        I have started an elasticsearch storage plugin for 1.10 but it seems quite difficult to understand Apache Drill interfaces (Java-Docs are not quite useful), if you can point me on some documentation explaining the interfaces to implement it would be nice.

        I have reviews some of the MongoDB implementation, and based on it, I started coding (https://github.com/javiercanillas/drill-storage-elastic). It's not finished yet, it is still on development.

        Any recommendations on documentation or any advice it will be very welcome.

        Show
        Kani Javier Canillas added a comment - Hi everyone, we are struggling with elasticSearch integration. Sql4es has started working on support for ES 5.X, but from our tests it still doesn't cover attributes being list or object types. I have started an elasticsearch storage plugin for 1.10 but it seems quite difficult to understand Apache Drill interfaces (Java-Docs are not quite useful), if you can point me on some documentation explaining the interfaces to implement it would be nice. I have reviews some of the MongoDB implementation, and based on it, I started coding ( https://github.com/javiercanillas/drill-storage-elastic ). It's not finished yet, it is still on development. Any recommendations on documentation or any advice it will be very welcome.
        Hide
        kguelzau Kai Gülzau added a comment -

        Ich bin bis zum 26.05. nicht im Büro und habe keinen Zugriff auf E-Mails.
        In dringenden Fällen wenden Sie sich bitte an support@novomind.com

        Viele Grüße,

        Kai Gülzau

        novomind AG

        Show
        kguelzau Kai Gülzau added a comment - Ich bin bis zum 26.05. nicht im Büro und habe keinen Zugriff auf E-Mails. In dringenden Fällen wenden Sie sich bitte an support@novomind.com Viele Grüße, Kai Gülzau – novomind AG

          People

          • Assignee:
            Unassigned
            Reporter:
            __andrew Andrew
          • Votes:
            6 Vote for this issue
            Watchers:
            16 Start watching this issue

            Dates

            • Created:
              Updated:

              Development