Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3187

Sqoop import as PARQUET to S3 failed

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.6
    • no-release
    • None
    • None

    Description

      Sqoop import as parquet file to S3 fails. Command and error are give below.
      However, import to a HDFS location works though.

      sqoop import --connect "jdbc:oracle:thin:@<ip_address>:1521/ORCL" --table mytable --username myuser --password mypass --target-dir s3://bucket/foo/bar/ --columns col1,col2 -m1 --as-parquetfile

      17/05/09 21:00:18 ERROR tool.ImportTool: Imported Failed: Wrong FS: s3://bucket/foo/bar, expected: hdfs://master-ip:8020

      P.S. I tried this from Amazon EMR cluster.

      Attachments

        Issue Links

          Activity

            People

              sanysandish@gmail.com Sandish Kumar HN
              sk4sj@yahoo.com Surendra Nichenametla
              Votes:
              1 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: