HBase
  1. HBase
  2. HBASE-9394

[replication] size accounting is completely off in the source

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.95.2
    • Fix Version/s: 0.98.0, 0.96.0
    • Component/s: None
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      I was under the impression that I was sending way more data than I was expecting, so adding some more tracing I can see how much data I read VS how I much I think I'm sending:

      Seeking at position 163771687
      Replicating 2 entries of total size 2790
      Seeking at position 166723643
      

      That's about 2MB of data, not 2KB.

      1. HBASE-9394.patch
        2 kB
        Jean-Daniel Cryans

        Activity

        Jean-Daniel Cryans created issue -
        Hide
        Jean-Daniel Cryans added a comment -

        I messed up in HBASE-5778, I fixed it in 0.94 but not in trunk.

        I'm also adding my new size debugging to the existing log, and putting more stuff to trace.

        Show
        Jean-Daniel Cryans added a comment - I messed up in HBASE-5778 , I fixed it in 0.94 but not in trunk. I'm also adding my new size debugging to the existing log, and putting more stuff to trace.
        Jean-Daniel Cryans made changes -
        Field Original Value New Value
        Attachment HBASE-9394.patch [ 12600811 ]
        Jean-Daniel Cryans made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Hide
        stack added a comment -

        +1

        Show
        stack added a comment - +1
        Hide
        Jean-Daniel Cryans added a comment -

        Committed to branch and trunk, thanks for reviewing Stack.

        Show
        Jean-Daniel Cryans added a comment - Committed to branch and trunk, thanks for reviewing Stack.
        Jean-Daniel Cryans made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags Reviewed [ 10343 ]
        Resolution Fixed [ 1 ]
        Hide
        Hudson added a comment -

        FAILURE: Integrated in hbase-0.95-on-hadoop2 #282 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/282/)
        HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519039)

        • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Show
        Hudson added a comment - FAILURE: Integrated in hbase-0.95-on-hadoop2 #282 (See https://builds.apache.org/job/hbase-0.95-on-hadoop2/282/ ) HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519039) /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Hide
        Hudson added a comment -

        FAILURE: Integrated in hbase-0.95 #510 (See https://builds.apache.org/job/hbase-0.95/510/)
        HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519039)

        • /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Show
        Hudson added a comment - FAILURE: Integrated in hbase-0.95 #510 (See https://builds.apache.org/job/hbase-0.95/510/ ) HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519039) /hbase/branches/0.95/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-TRUNK #4451 (See https://builds.apache.org/job/HBase-TRUNK/4451/)
        HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519040)

        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-TRUNK #4451 (See https://builds.apache.org/job/HBase-TRUNK/4451/ ) HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519040) /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Hide
        Hudson added a comment -

        SUCCESS: Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #705 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/705/)
        HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519040)

        • /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Show
        Hudson added a comment - SUCCESS: Integrated in HBase-TRUNK-on-Hadoop-2.0.0 #705 (See https://builds.apache.org/job/HBase-TRUNK-on-Hadoop-2.0.0/705/ ) HBASE-9394 [replication] size accounting is completely off in the source (jdcryans: rev 1519040) /hbase/trunk/hbase-server/src/main/java/org/apache/hadoop/hbase/replication/regionserver/ReplicationSource.java
        Transition Time In Source Status Execution Times Last Executer Last Execution Date
        Open Open Patch Available Patch Available
        17m 9s 1 Jean-Daniel Cryans 30/Aug/13 18:07
        Patch Available Patch Available Resolved Resolved
        1h 3m 1 Jean-Daniel Cryans 30/Aug/13 19:11

          People

          • Assignee:
            Jean-Daniel Cryans
            Reporter:
            Jean-Daniel Cryans
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Development