Uploaded image for project: 'HBase'
  1. HBase
  2. HBASE-15133

Data loss after compaction when a row has more than Integer.MAX_VALUE columns

    XMLWordPrintableJSON

    Details

    • Type: Bug
    • Status: Resolved
    • Priority: Major
    • Resolution: Fixed
    • Affects Version/s: None
    • Fix Version/s: 1.2.0, 1.3.0, 0.98.18, 2.0.0
    • Component/s: Compaction
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      We have lost the data in our development environment when a row has more than Integer.MAX_VALUE columns after compaction.

      I think the reason is type of StoreScanner's countPerRow is int.

      https://github.com/apache/hbase/blob/master/hbase-server/src/main/java/org/apache/hadoop/hbase/regionserver/StoreScanner.java#L67

      After changing the type to long, it seems to be fixed.

        Attachments

        1. HBASE-15133.patch
          0.7 kB
          Ted Yu
        2. HBASE-15133.patch
          0.7 kB
          Toshihiro Suzuki
        3. HBASE-15133-v1.patch
          25 kB
          Toshihiro Suzuki

          Activity

            People

            • Assignee:
              brfrn169 Toshihiro Suzuki
              Reporter:
              brfrn169 Toshihiro Suzuki
            • Votes:
              0 Vote for this issue
              Watchers:
              9 Start watching this issue

              Dates

              • Created:
                Updated:
                Resolved: