Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-999

Support bulk load from HDFS to PostgreSQL using COPY ... FROM

    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: 1.4.3
    • Fix Version/s: 1.4.4
    • Component/s: connectors/postgresql
    • Labels:
      None
    • Environment:

      PostgreSQL

      Description

      Initially taken from here:
      https://issues.cloudera.org/browse/SQOOP-184
      As Cloudera site is no longer used:

      Sqoop currently supports bulk export from PostgreSQL but not bulk import. PostgreSQL support COPY <table> FROM <filename> syntax and readily accepts CSV data. We should support this so there is --direct support in both directions.

      A note from myself:
      the pg_bulkupload feature is already implemented:
      https://issues.apache.org/jira/browse/SQOOP-390
      pg_builupload is a third-party tool, I guess supporting COPY would be a better case.

        Attachments

        1. export-to-postgresql-with-copy.patch
          13 kB
          Masatake Iwasaki
        2. export-to-postgresql-with-copy.1.patch
          18 kB
          Masatake Iwasaki

          Issue Links

          relates to

          Improvement - An improvement or enhancement to an existing feature or task. SQOOP-2972 SQOOP Direct Export To PostgreSQL Supports Selective Columns

          • Major - Major loss of function.
          • Patch Available

          Task - A task that needs to be done. SQOOP-1118 Move PostgreSQL specific MR codes to org.apache.sqoop.mapreduce.posgresql

          • Trivial - Cosmetic problem like misspelt words or misaligned text.
          • Resolved
          links to

          Web Link Review board link

            Activity

              People

              • Assignee:
                iwasakims Masatake Iwasaki
                Reporter:
                metaruslan Ruslan Al-Fakikh
              • Votes:
                0 Vote for this issue
                Watchers:
                7 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: