Flume
  1. Flume
  2. FLUME-2754

Hive Sink skipping first transaction in each Batch of Hive Transactions

    Details

    • Type: Bug Bug
    • Status: Closed
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: v1.5.0, v1.6.0
    • Fix Version/s: v1.7.0
    • Component/s: None
    • Labels:
      None
    1. FLUME-2754.patch
      3 kB
      Deepesh Khandelwal

      Activity

      Hide
      Deepesh Khandelwal added a comment -

      The patch fixes the skipping of the first transaction in the transaction batch.
      The problem is due to auto switching to the first Transaction in fetchTxnBatch() and then again performing a beginNextTxn() on the return value.
      Remove the auto switch to first Transaction in fetchTxnBatch

      Show
      Deepesh Khandelwal added a comment - The patch fixes the skipping of the first transaction in the transaction batch. The problem is due to auto switching to the first Transaction in fetchTxnBatch() and then again performing a beginNextTxn() on the return value. Remove the auto switch to first Transaction in fetchTxnBatch
      Hide
      Roshan Naik added a comment -

      Thanks Deepesh Khandelwal for patch and including the test.
      +1

      Show
      Roshan Naik added a comment - Thanks Deepesh Khandelwal for patch and including the test. +1
      Hide
      ASF subversion and git services added a comment -

      Commit 318da208844d02ed7554724ae526cefe94dd894c in flume's branch refs/heads/trunk from Roshan Naik
      [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=318da20 ]

      FLUME-2754 - Hive Sink skipping first transaction in each Batch of Hive Transactions

      (Deepesh Khandelwal via Roshan Naik)

      Show
      ASF subversion and git services added a comment - Commit 318da208844d02ed7554724ae526cefe94dd894c in flume's branch refs/heads/trunk from Roshan Naik [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=318da20 ] FLUME-2754 - Hive Sink skipping first transaction in each Batch of Hive Transactions (Deepesh Khandelwal via Roshan Naik)
      Hide
      ASF subversion and git services added a comment -

      Commit 131dfb2e581e4ab8c78dad2c990f1ec6fd1f0ffe in flume's branch refs/heads/flume-1.7 from Roshan Naik
      [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=131dfb2 ]

      FLUME-2754 - Hive Sink skipping first transaction in each Batch of Hive Transactions

      (Deepesh Khandelwal via Roshan Naik)

      Show
      ASF subversion and git services added a comment - Commit 131dfb2e581e4ab8c78dad2c990f1ec6fd1f0ffe in flume's branch refs/heads/flume-1.7 from Roshan Naik [ https://git-wip-us.apache.org/repos/asf?p=flume.git;h=131dfb2 ] FLUME-2754 - Hive Sink skipping first transaction in each Batch of Hive Transactions (Deepesh Khandelwal via Roshan Naik)
      Hide
      Roshan Naik added a comment -

      Committed.

      Show
      Roshan Naik added a comment - Committed.
      Hide
      Hudson added a comment -

      SUCCESS: Integrated in Flume-trunk-hbase-1 #121 (See https://builds.apache.org/job/Flume-trunk-hbase-1/121/)
      FLUME-2754 - Hive Sink skipping first transaction in each Batch of Hive Transactions (roshan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=318da208844d02ed7554724ae526cefe94dd894c)

      • flume-ng-sinks/flume-hive-sink/src/main/java/org/apache/flume/sink/hive/HiveWriter.java
      • flume-ng-sinks/flume-hive-sink/src/test/java/org/apache/flume/sink/hive/TestHiveWriter.java
      Show
      Hudson added a comment - SUCCESS: Integrated in Flume-trunk-hbase-1 #121 (See https://builds.apache.org/job/Flume-trunk-hbase-1/121/ ) FLUME-2754 - Hive Sink skipping first transaction in each Batch of Hive Transactions (roshan: http://git-wip-us.apache.org/repos/asf/flume/repo?p=flume.git&a=commit&h=318da208844d02ed7554724ae526cefe94dd894c ) flume-ng-sinks/flume-hive-sink/src/main/java/org/apache/flume/sink/hive/HiveWriter.java flume-ng-sinks/flume-hive-sink/src/test/java/org/apache/flume/sink/hive/TestHiveWriter.java
      Hide
      Deepesh Khandelwal added a comment -

      Thanks Roshan Naik for review and commit!

      Show
      Deepesh Khandelwal added a comment - Thanks Roshan Naik for review and commit!

        People

        • Assignee:
          Deepesh Khandelwal
          Reporter:
          Roshan Naik
        • Votes:
          0 Vote for this issue
          Watchers:
          4 Start watching this issue

          Dates

          • Created:
            Updated:
            Resolved:

            Development