Uploaded image for project: 'Phoenix'
  1. Phoenix
  2. PHOENIX-2748

CsvToKeyValueMapper used by CsvBulkLoadTool should set inner PhoenixConnection autoCommit to false explicitly

    XMLWordPrintableJSON

Details

    • Bug
    • Status: Closed
    • Minor
    • Resolution: Fixed
    • 4.6.0
    • 4.8.0
    • None
    • None
    • Phoenix 4.6.0-HBase-0.98, HBase 0.98.6-cdh5.3.2

    Description

      CsvBulkLoadTool uses CsvToKeyValueMapper to convert csv record to KeyValues which should be inserted into target table , and CsvToKeyValueMapper gets the KeyValues by mocking upsert sql to target table,so the PhoenixConnection's autoCommit should be false,but CsvToKeyValueMapper does not set inner PhoenixConnection autoCommit to false explicitly. When we set "phoenix.connection.autoCommit" to true in hbase-site.xml,CsvToKeyValueMapper will really execute upsert sql to target table,which is not expected.

      So CsvToKeyValueMapper should set inner PhoenixConnection autoCommit to false explicitly,just as PhoenixIndexImportMapper does.

      Attachments

        1. PHOENIX-2748.patch
          1 kB
          Gabriel Reid

        Activity

          People

            gabriel.reid Gabriel Reid
            comnetwork chenglei
            Votes:
            0 Vote for this issue
            Watchers:
            3 Start watching this issue

            Dates

              Created:
              Updated:
              Resolved: