[HADOOP-13435] Add thread local mechanism for aggregating file system storage stats - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Patch Available
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: fs
Labels:
None

Description

As discussed in HADOOP-13032, this is to add thread local mechanism for aggregating file system storage stats. This class will also be used in HADOOP-13031, which is to separate the distance-oriented rack-aware read bytes logic from FileSystemStorageStatistics to new DFSRackAwareStorageStatistics as it's DFS-specific. After this patch, the FileSystemStorageStatistics can live without the to-be-removed FileSystem$Statistics implementation.

A unit test should also be added.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HADOOP-13435.000.patch
28/Jul/16 17:53
36 kB
Mingliang Liu
HADOOP-13435.001.patch
28/Jul/16 20:26
36 kB
Mingliang Liu
HADOOP-13435.002.patch
28/Jul/16 21:16
36 kB
Mingliang Liu
HADOOP-13435.003.patch
06/Jul/17 01:26
38 kB
Mingliang Liu
HADOOP-13435.004.patch
06/Jul/17 18:23
38 kB
Mingliang Liu

Issue Links

blocks

HADOOP-13032 Refactor FileSystem$Statistics to use StorageStatistics

Open

relates to

HDFS-5276 FileSystem.Statistics got performance issue on multi-thread read/write.

Closed

Activity

People

Assignee:: Unassigned

Reporter:: Mingliang Liu

Votes:: 0 Vote for this issue

Watchers:: 13 Start watching this issue

Dates

Created:: 28/Jul/16 17:49

Updated:: 18/Apr/20 07:00