[HDFS-11698] Ozone: SCM: CLI: Add Debug command

• Type: Sub-task
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: HDFS-7240
• Fix Version/s: HDFS-7240
• Component/s: ozone
• Target Version/s: HDFS-7240
• Hadoop Flags: Reviewed
• Assignee: Chen Liang
• Reporter: Anu Engineer
• Created: 24/Apr/17 20:07
• Updated: 26/Apr/18 21:50
• Resolved: 04/May/17 21:10

Description

This is not discussed as part of the standard command line set, since these are internal debug only commands.

We have levelDB that stores key, value pairs and value is always binary blobs. These binary blobs can only be decoded using protobuf classes that are part of ozone.

We would like to add an extension to SCM CLI which allows us to convert levelDB to SQLlite, since SQLlite would have structured data and standard SQL will work against it.

The reason to use SQLlite instead of some dump file like json is the scale, it is possible that some levelDB files will have millions of keys, so having an SQL DB with proper index will make debugging much easier.

Issue Links

• depends upon: HDFS-11728 Ozone: add the DB names to OzoneConsts
• is depended upon by: HDFS-11756 Ozone : add DEBUG CLI support of blockDB file