[HBASE-16189] [Rolling Upgrade] 2.0 hfiles cannot be opened by 1.x servers

• Type: Sub-task
• Status: Closed
• Priority: Critical
• Resolution: Fixed
• Fix Version/s: 1.3.0, 1.1.6, 1.2.3
• Component/s: migration
• Hadoop Flags: Reviewed
• Assignee: ramkrishna.s.vasudevan
• Reporter: Enis Soztutar
• Created: 06/Jul/16 19:14
• Updated: 24/Jun/22 18:04
• Resolved: 18/Jul/16 04:51

Description

HBASE-10800 added MetaCellComparator, which gets written to the HFile. 1.x code does not have the new class, hence fails to open the regions. I did not check whether this is only for meta or for regular tables as well.

Caused by: org.apache.hadoop.hbase.io.hfile.CorruptHFileException: Problem reading HFile Trailer from file hdfs://cn017.l42scl.hortonworks.com:8020/apps/hbase/data/data/hbase/meta/1588230740/info/aa96e4ef463b4a82956330b236440437
        at org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:483)
        at org.apache.hadoop.hbase.io.hfile.HFile.createReader(HFile.java:511)
        at org.apache.hadoop.hbase.regionserver.StoreFile$Reader.<init>(StoreFile.java:1123)
        at org.apache.hadoop.hbase.regionserver.StoreFileInfo.open(StoreFileInfo.java:267)
        at org.apache.hadoop.hbase.regionserver.StoreFile.open(StoreFile.java:409)
        at org.apache.hadoop.hbase.regionserver.StoreFile.createReader(StoreFile.java:512)
        at org.apache.hadoop.hbase.regionserver.HStore.createStoreFileAndReader(HStore.java:687)
        at org.apache.hadoop.hbase.regionserver.HStore.access$000(HStore.java:130)
        at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:554)
        at org.apache.hadoop.hbase.regionserver.HStore$1.call(HStore.java:551)
        ... 6 more
Caused by: java.io.IOException: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.CellComparator$MetaCellComparator
        at org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(FixedFileTrailer.java:581)
        at org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.deserializeFromPB(FixedFileTrailer.java:300)
        at org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.deserialize(FixedFileTrailer.java:242)
        at org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.readFromStream(FixedFileTrailer.java:407)
        at org.apache.hadoop.hbase.io.hfile.HFile.pickReaderVersion(HFile.java:468)
        ... 15 more
Caused by: java.lang.ClassNotFoundException: org.apache.hadoop.hbase.CellComparator$MetaCellComparator
        at java.net.URLClassLoader.findClass(URLClassLoader.java:381)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:424)
        at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:331)
        at java.lang.ClassLoader.loadClass(ClassLoader.java:357)
        at java.lang.Class.forName0(Native Method)
        at java.lang.Class.forName(Class.java:264)
        at org.apache.hadoop.hbase.io.hfile.FixedFileTrailer.getComparatorClass(FixedFileTrailer.java:579)

Issue Links

• relates to: HBASE-19052 FixedFileTrailer should recognize CellComparatorImpl class in branch-1.x
• supercedes: HBASE-21525 java.io.IOException: java.lang.ClassNotFoundException: clone_snapshot from hbase2.0.0 to hbase1.2.0