Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-3156

PostgreSQL direct connector is ignoring --columns

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Open
    • Priority: Minor
    • Resolution: Unresolved
    • Affects Version/s: 1.4.6
    • Fix Version/s: None
    • Component/s: connectors/postgresql
    • Labels:
      None

      Description

      DirectPostgresqlManager seems to directly query the columns of the table and use those instead of using the passed in --columns

      can be reproduced using something like this:
      sqoop import --connect jdbc:postgresql://foo.com/chdbfoo --username foouser --password foopassword --hive-import --direct --table footable --columns "col1,col2,col3" --where "col1 is not null " --direct-split-size 268435456 --hive-table foohive_table

      if that table has more columns than col1, col2, and col3, those will also be queried

        Attachments

          Activity

            People

            • Assignee:
              ericlin Eric Lin
              Reporter:
              ch_smathews Shane Mathews
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: