Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-2228

Sqoop2: HDFS Connector: Import data to temporary directory before moving them to target directory

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.99.5
    • 1.99.6
    • None
    • None

    Description

      Current HDFS connector will import data directory to target directory. This is a trouble as anyone who will read the directory mid Sqoop job will get partial results and that will be even bigger problem when incremental will be enabled. Hence I would propose to change this behavior to firstly import data to temporary directory and move them to target directory only as long as entire job will be successful.

      Attachments

        1. SQOOP-2228.patch
          15 kB
          Jarek Jarcec Cecho

        Issue Links

          is required by

          Bug - A problem which impairs or prevents the functions of the product. SQOOP-1949 Sqoop2: HDFS append only support

          • Major - Major loss of function.
          • Resolved
          links to

          Web Link Review board

          Activity

            People

              jarcec Jarek Jarcec Cecho
              jarcec Jarek Jarcec Cecho
              Votes:
              0 Vote for this issue
              Watchers:
              5 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved:

                Slack

                  Issue deployment