Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3345 Make Sqoop work with S3: test and document current capabilities
  3. SQOOP-3368

Add fail-fast scenarios to S3 incremental import use cases without --temporary-rootdir option

    XMLWordPrintableJSON

Details

    • Sub-task
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.7
    • 3.0.0
    • None
    • None

    Description

      The current implementation of Sqoop handles HDFS as a default filesystem, i.e. it creates temporary directories on HDFS in case of incremental append or merge imports. To make these incremental import use cases work with S3 the user needs to set the --temporary-rootdir to an S3 location properly.

      There should be fail-fast scenarios without the --temporary-rootdir option.

      Attachments

        1. SQOOP-3368.patch
          7 kB
          Boglarka Egyed
        2. SQOOP-3368.patch
          6 kB
          Boglarka Egyed
        3. SQOOP-3368.patch
          6 kB
          Boglarka Egyed

        Issue Links

          links to

          Web Link ReviewBoard

          Activity

            People

              BoglarkaEgyed Boglarka Egyed
              BoglarkaEgyed Boglarka Egyed
              Votes:
              0 Vote for this issue
              Watchers:
              3 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: