[HBASE-1430] Read the logs in batches during log splitting to avoid OOME - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Closed
Priority: Blocker
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 0.20.0, 0.19.3
Component/s: None
Labels:
None

Hadoop Flags:

Reviewed

Description

During log splitting, in the worst case we can read 64 logs of 64MB which will surely bust any heap. Instead we should read the logs in batches of 5-10 that we write right away.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

hbase-1430-trunk-v1.patch
19/May/09 20:59
14 kB
Jean-Daniel Cryans

Activity

People

Assignee:: Jean-Daniel Cryans

Reporter:: Jean-Daniel Cryans

Votes:: 0 Vote for this issue

Watchers:: 0 Start watching this issue

Dates

Created:: 16/May/09 14:40

Updated:: 13/Sep/09 22:24

Resolved:: 20/May/09 17:07