Uploaded image for project: 'Sqoop'
  1. Sqoop
  2. SQOOP-3125

NULL updates are not pulled into Hbase whenever incremental load happens in sqoop

    Details

    • Type: Bug
    • Status: Open
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 1.4.6
    • Fix Version/s: None
    • Component/s: connectors/oracle
    • Labels:
      None
    • Environment:

      MapR Hadoop

      Description

      Ingesting data from Oracle to HBase using Sqoop and fetching data from HBase using Hive tables using HBaseStorageHandler.

      Problem is whenever incremental load happens from Sqoop and if a column is updated with "null",

      HBase doesn't gets updated with null value for that cell and when the data is fetched from HBase using Hive table it fetches last updated timestamp record.

      So the entire record becomes inconsistent as for all the columns it shows updated value and for the "null" column it shows old value of it as timestamp is not updated.

        Attachments

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              selvakumar7 Selvakumar
            • Votes:
              0 Vote for this issue
              Watchers:
              2 Start watching this issue

              Dates

              • Created:
                Updated: