[HBASE-15204] Try to estimate the cell count for adding into WALEdit - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 1.3.0, 2.0.0
Component/s: regionserver
Labels:
None

Hadoop Flags:

Reviewed

Description

The write path profiling shows that when we try to add Cells to WALEdits we try to do a lot of Array copy inorder to grow the Arraylist backing the WALEdits. In a simple one min profiling of the write path with 50 YCSB threads shows around 261MB of allocation done for the Array copy to happen. We can try to avoid that.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HBASE-15204_branch-1.patch
11/Feb/16 03:56
4 kB
ramkrishna.s.vasudevan
HBASE-15204_4.patch
09/Feb/16 08:30
4 kB
ramkrishna.s.vasudevan
HBASE-15204_3.patch
08/Feb/16 12:22
4 kB
ramkrishna.s.vasudevan
HBASE-15204_3.patch
08/Feb/16 11:49
4 kB
ramkrishna.s.vasudevan
HBASE-15204_2.patch
06/Feb/16 16:23
6 kB
ramkrishna.s.vasudevan
HBASE-15204_1.patch
05/Feb/16 05:05
5 kB
ramkrishna.s.vasudevan
HBASE-15204_1.patch
04/Feb/16 10:52
5 kB
ramkrishna.s.vasudevan
HBASE-15204.patch
02/Feb/16 08:50
8 kB
ramkrishna.s.vasudevan
WAlEdit_add_allocation_after_patch.jpg
02/Feb/16 08:50
162 kB
ramkrishna.s.vasudevan
WAlEdit_add_allocation.jpg
02/Feb/16 08:50
52 kB
ramkrishna.s.vasudevan

Issue Links

is related to

HBASE-17488 WALEdit should be lazily instantiated

Resolved

Activity

People

Assignee:: ramkrishna.s.vasudevan

Reporter:: ramkrishna.s.vasudevan

Votes:: 0 Vote for this issue

Watchers:: 7 Start watching this issue

Dates

Created:: 02/Feb/16 08:47

Updated:: 01/Jul/22 21:33

Resolved:: 11/Feb/16 03:58