Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-999

Support bulk load from HDFS to PostgreSQL using COPY ... FROM

    XMLWordPrintableJSON

Details

    • New Feature
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • 1.4.3
    • 1.4.4
    • connectors/postgresql
    • None
    • PostgreSQL

    Description

      Initially taken from here:
      https://issues.cloudera.org/browse/SQOOP-184
      As Cloudera site is no longer used:

      Sqoop currently supports bulk export from PostgreSQL but not bulk import. PostgreSQL support COPY <table> FROM <filename> syntax and readily accepts CSV data. We should support this so there is --direct support in both directions.

      A note from myself:
      the pg_bulkupload feature is already implemented:
      https://issues.apache.org/jira/browse/SQOOP-390
      pg_builupload is a third-party tool, I guess supporting COPY would be a better case.

      Attachments

        1. export-to-postgresql-with-copy.patch
          13 kB
          Masatake Iwasaki
        2. export-to-postgresql-with-copy.1.patch
          18 kB
          Masatake Iwasaki

        Issue Links

          Activity

            People

              iwasakims Masatake Iwasaki
              metaruslan Ruslan Al-Fakikh
              Votes:
              0 Vote for this issue
              Watchers:
              7 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: