Uploaded image for project: 'Sqoop (Retired)'
  1. Sqoop (Retired)
  2. SQOOP-3156

PostgreSQL direct connector is ignoring --columns

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Open
    • Minor
    • Resolution: Unresolved
    • 1.4.6
    • None
    • connectors/postgresql
    • None

    Description

      DirectPostgresqlManager seems to directly query the columns of the table and use those instead of using the passed in --columns

      can be reproduced using something like this:
      sqoop import --connect jdbc:postgresql://foo.com/chdbfoo --username foouser --password foopassword --hive-import --direct --table footable --columns "col1,col2,col3" --where "col1 is not null " --direct-split-size 268435456 --hive-table foohive_table

      if that table has more columns than col1, col2, and col3, those will also be queried

      Attachments

        Activity

          People

            ericlin Eric Lin
            ch_smathews Shane Mathews
            Votes:
            0 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

              Created:
              Updated: