[HADOOP-13738] DiskChecker should perform some disk IO - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.9.0, 3.0.0-alpha2, 2.8.5
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

DiskChecker can fail to detect total disk/controller failures indefinitely. We have seen this in real clusters. DiskChecker performs simple permissions-based checks on directories which do not guarantee that any disk IO will be attempted.

A simple improvement is to write some data and flush it to the disk.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HADOOP-13738.01.patch
19/Oct/16 23:47
10 kB
Arpit Agarwal
HADOOP-13738.02.patch
24/Oct/16 23:03
11 kB
Arpit Agarwal
HADOOP-13738.03.patch
24/Oct/16 23:28
12 kB
Arpit Agarwal
HADOOP-13738.04.patch
28/Oct/16 22:15
16 kB
Arpit Agarwal
HADOOP-13738.05.patch
28/Oct/16 23:16
16 kB
Arpit Agarwal
HADOOP-13738-branch-2.8-06.patch
03/Jan/18 12:01
17 kB
Vinayakumar B

Issue Links

breaks

HADOOP-15450 Avoid fsync storm triggered by DiskChecker and handle disk full situation

Resolved

is blocked by

HADOOP-13737 Cleanup DiskChecker interface

Resolved

Activity

People

Assignee:: Arpit Agarwal

Reporter:: Arpit Agarwal

Votes:: 0 Vote for this issue

Watchers:: 15 Start watching this issue

Dates

Created:: 19/Oct/16 23:37

Updated:: 21/Aug/18 23:04

Resolved:: 10/Jan/18 13:21