[HDFS-15995] Rework HDFS-15624 Fix the SetQuotaByStorageTypeOp problem after updating hadoop

• Type: Bug
• Status: Resolved
• Priority: Blocker
• Resolution: Done
• Affects Version/s: 3.4.0
• Fix Version/s: 3.4.0
• Assignee: Wei-Chiu Chuang
• Reporter: Wei-Chiu Chuang
• Created: 24/Apr/21 01:33
• Updated: 04/May/21 01:45
• Resolved: 04/May/21 01:45

Description

As discussed in the mailing list,

In HDFS-15624 (fix the function of setting quota by storage type), A new layout version was added
NVDIMM_SUPPORT(-66, -61, "Support NVDIMM storage type");
This was added for 3.4.0 (trunk)

However, there's another jira
HDFS-15566 (NN restart fails after RollingUpgrade from 3.1.3/3.2.1 to 3.3.0)
SNAPSHOT_MODIFICATION_TIME(-66, -61, "Support modification time for snapshot");

where Brahma wanted to add a new layout version in branch-3.3 (3.3.1). The patch got stalled awhile ago and I'm trying to commit it in preparation of 3.3.1 release.

However, both new layout versions conflict because they intend to use the new same version id. We can't release 3.3.1 without HDFS-15566 but we can't use layout id -66 because of HDFS-15624.

I propose:
revert HDFS-15624 (NVDIMM_SUPPORT),
commit HDFS-15566 (SNAPSHOT_MODIFICATION_TIME)
re-work on HDFS-15624 but with layout version id -67

Issue Links

• blocks: HADOOP-17647 Release Hadoop 3.3.1
• is related to: HDFS-15624 Fix the SetQuotaByStorageTypeOp problem after updating hadoop