[HBASE-7704] migration tool that checks presence of HFile V1 files

• Type: Task
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 0.95.1
• Hadoop Flags: Reviewed

Release Note

Adds tool to check if any v1 hfiles present under hbase.rootdir. Run this tool before you move to hbase 0.95/0.96 because hfile v1 files are no longer supported in the newer versions of hbase (If an hfile v1 is found, run a major compaction on the offending, containing region and that should purge the v1 file).

Here is what the usage for the tool looks like:


{code}
bin/hbase org.apache.hadoop.hbase.util.HFileV1Detector -h
usage: HFileV1Detector [-h] [-n <arg>] [-p <arg>]
 -h,--help Help
 -n,--numberOfThreads <arg> Number of threads to use while processing
                              HFiles.
 -p,--path <arg> Path to a table, or hbase installation
In case no option is provided, it processes hbase.rootdir using 10 threads.
Example:
 To detect any HFileV1 in a given hbase installation '/myhbase':
 $ $HBASE_HOME/bin/hbase org.apache.hadoop.hbase.util.HFileV1Detector -p /myhbase
{code}

• Assignee: Himanshu Vashishtha
• Reporter: Ted Yu
• Created: 29/Jan/13 05:53
• Updated: 23/Sep/13 19:08
• Resolved: 23/Apr/13 05:51

Description

Below was Stack's comment from HBASE-7660:

Regards the migration 'tool', or 'tool' to check for presence of v1 files, I imagine it as an addition to the hfile tool http://hbase.apache.org/book.html#hfile_tool2 The hfile tool already takes a bunch of args including printing out meta. We could add an option to print out version only – or return 1 if version 1 or some such – and then do a bit of code to just list all hfiles and run this script against each. Could MR it if too many files.

Issue Links

• is related to: HBASE-7660 Remove HFileV1 code