Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-1303

Can only write to default file system on incremental import

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.4.5
    • None
    • None

    Description

      Running 'sqoop import' with the --incremental option fails if the --target-dir option points to a directory that is not in fs.default.name. In my case I was writing to s3 on a machine not configured so default fs was file:///.

      When running I received this error:
      ERROR sqoop.Sqoop: Got exception running Sqoop: java.lang.IllegalArgumentException: Wrong FS: s3://mybucket/mydirectory, expected: file:///

      Attachments

        1. fix-append.diff
          1 kB
          Mark Roddy

        Activity

          People

            markroddy Mark Roddy
            markroddy Mark Roddy
            Votes:
            0 Vote for this issue
            Watchers:
            6 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: