[HADOOP-19291] `CombinedFileRange.merge` should not convert disjoint ranges into overlapped ones

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.3.9, 3.5.0, 3.4.1
• Fix Version/s: 3.4.1
• Component/s: common
• Labels: pull-request-available
• Assignee: Mukund Thakur
• Reporter: Dongjoon Hyun
• Created: 29/Sep/24 05:01
• Updated: 15/Oct/24 14:46
• Resolved: 10/Oct/24 08:52

Description

Currently, Hadoop has a bug to convert disjoint ranges into overlapped ones and eventually fails by itself.

+  public void testMergeSortedRanges() {
+    List<FileRange> input = asList(
+        createFileRange(13816220, 24, null),
+        createFileRange(13816244, 7423960, null)
+    );
+    assertIsNotOrderedDisjoint(input, 100, 800);
+    final List<CombinedFileRange> outputList = mergeSortedRanges(
+        sortRangeList(input), 100, 1001, 2500);
+
+    assertRangeListSize(outputList, 1);
+    assertFileRange(outputList.get(0), 13816200, 7424100);
+  }

Issue Links

• is duplicated by: HDFS-17633 `CombinedFileRange.merge` should not convert disjoint ranges into overlapped ones
• links to: GitHub Pull Request #7079
• links to: GitHub Pull Request #7101