Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3385

Error while connecting to S3 using Sqoop

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 1.4.7
    • None
    • connectors

    Description

      I am facing an issue while trying to import file from On Prem DB to S3 using Sqoop.

      Things I an able to do-

      1- I am connected to S3 , able to run aws s3 ls & other AWS cli commands

      2- Able to generate a file connecting to DB to local Unix box.

      But when I change the target directory to S3 instead of locat I am getting below error-

       
      "ERROR tool.ImportTool: Import failed: AWS Access Key ID and Secret Access Key must be specified as the username or password (respectively) of a s3 URL, or by setting the fs.s3.awsAccessKeyId or fs.s3.awsSecretAccessKey properties (respectively)."
       
      Ideally the Sqoop installation should be able to pick up the credentials from credential file inside .aws directory of the user running the command but  Is there a way I can specify the credentials?
       
      Thanks in advance.
       

      Attachments

        Activity

          People

            Unassigned Unassigned
            coolsm19 Suchit
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated: