[HDFS-10713] Throttle FsNameSystem lock warnings - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 2.8.0, 2.7.4, 3.0.0-alpha2
Component/s: logging, namenode
Labels:
None

Hadoop Flags:

Reviewed

Description

The NameNode logs a message if the FSNamesystem write lock is held by a thread for over 1 second. These messages can be throttled to at one most one per x minutes to avoid potentially filling up NN logs. We can also log the number of suppressed notices since the last log message.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HDFS-10713.000.patch
29/Aug/16 22:37
8 kB
Hanisha Koneru
HDFS-10713.001.patch
31/Aug/16 02:09
9 kB
Hanisha Koneru
HDFS-10713.002.patch
31/Aug/16 20:39
9 kB
Hanisha Koneru
HDFS-10713.003.patch
03/Sep/16 00:55
15 kB
Hanisha Koneru
HDFS-10713.004.patch
08/Sep/16 17:57
15 kB
Hanisha Koneru
HDFS-10713.005.patch
08/Sep/16 19:45
16 kB
Hanisha Koneru
HDFS-10713.006.patch
13/Sep/16 18:45
15 kB
Hanisha Koneru
HDFS-10713.007.patch
16/Sep/16 00:28
19 kB
Hanisha Koneru
HDFS-10713.008.patch
16/Sep/16 18:17
19 kB
Hanisha Koneru
HDFS-10713.009.patch
16/Sep/16 22:01
19 kB
Hanisha Koneru
HDFS-10713.010.patch
16/Sep/16 22:28
19 kB
Hanisha Koneru
HDFS-10713.011.patch
18/Sep/16 01:22
19 kB
Hanisha Koneru
HDFS-10713.012.patch
19/Sep/16 23:46
18 kB
Hanisha Koneru
HDFS-10713.branch-2.000.patch
27/Sep/16 00:47
18 kB
Hanisha Koneru

Issue Links

is depended upon by

HDFS-10829 Improve Testing for NN Lock Logging

Open

is related to

HDFS-9145 Tracking methods that hold FSNamesystemLock for too long

Resolved

relates to

HDFS-10475 Adding metrics for long FSNamesystem read and write locks

Open

Activity

People

Assignee:: Hanisha Koneru

Reporter:: Arpit Agarwal

Votes:: 0 Vote for this issue

Watchers:: 10 Start watching this issue

Dates

Created:: 01/Aug/16 22:57

Updated:: 30/Sep/16 23:30

Resolved:: 27/Sep/16 16:08