Uploaded image for project: 'Apache Drill'
  1. Apache Drill
  2. DRILL-4959

Drill 1.8 not able to connect to S3

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Major
    • Resolution: Fixed
    • 1.8.0
    • None
    • None
    • None

    Description

      Hi Team,

      I have followed below details to integrate Drill with AWS S3. Query keep running for hours and doesn't display any output (I am querying only 2 row file from S3).

      Reference link
      -------------------
      https://abhishek-tiwari.com/post/reflections-on-apache-drill
      https://drill.apache.org/docs/s3-storage-plugin/

      Query Format (Tried from UI & CLI)
      ----------------------------------------------------
      select * from `s3`.`hive.csv` LIMIT 10;
      select * from `s3`.`bucket_name/hive.csv` LIMIT 10;

      After seeing below log, I tried including jets3t-0.9.3.jar in jars directory but it doesn't fix my problem.

      Log Details
      --------------
      2016-10-24 17:00:02,461 [27f1c1ec-d82e-ba2a-2840-e7104320418f:foreman] INFO o.a.drill.exec.work.foreman.Foreman - Query text for query id 27f1c1ec-d82e-ba2a-2840-e7104320418f: select * from `s3`.`hive.csv` LIMIT 10
      2016-10-24 17:00:02,479 [drill-executor-39] ERROR o.a.d.exec.server.BootStrapContext - org.apache.drill.exec.work.foreman.Foreman.run() leaked an exception.
      java.lang.NoClassDefFoundError: org/jets3t/service/S3ServiceException

      Attachments

        Activity

          People

            Unassigned Unassigned
            gopalnagar13@gmail.com Gopal Nagar
            Votes:
            0 Vote for this issue
            Watchers:
            1 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: