[HDFS-15618] Improve datanode shutdown latency - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 3.2.2, 3.3.1, 3.4.0, 2.10.2, 3.2.3
Component/s: datanode
Labels:
None

Hadoop Flags:

Reviewed

Description

The shutdown of Datanode is a very long latency. A block scanner waits for 5 minutes to join on each VolumeScanner thread.
Since the scanners are daemon threads and do not alter the block content, it is safe to ignore such conditions on shutdown of Datanode.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-15618.001.patch
09/Oct/20 02:17
15 kB
Ahmed Hussein
HDFS-15618.002.patch
12/Oct/20 17:15
16 kB
Ahmed Hussein
HDFS-15618.003.patch
16/Oct/20 00:34
16 kB
Ahmed Hussein
HDFS-15618.004.patch
16/Oct/20 20:22
21 kB
Ahmed Hussein
HDFS-15618-branch-2.10.001.patch
14/Jun/21 21:23
21 kB
Ahmed Hussein
HDFS-15618-branch-2.10.002.patch
15/Jun/21 14:48
22 kB
Ahmed Hussein
HDFS-15618-branch-2.10.003.patch
15/Jun/21 18:01
21 kB
Ahmed Hussein
HDFS-15618-branch-3.3.004.patch
21/Oct/20 16:27
21 kB
Ahmed Hussein

Issue Links

is related to

HDFS-9409 DataNode shutdown does not guarantee full shutdown of all threads due to race condition.

Open

Activity

People

Assignee:: Ahmed Hussein

Reporter:: Ahmed Hussein

Votes:: 0 Vote for this issue

Watchers:: 6 Start watching this issue

Dates

Created:: 09/Oct/20 02:15

Updated:: 16/Jun/21 16:40

Resolved:: 16/Jun/21 16:40