Details
-
Umbrella
-
Status: Resolved
-
Major
-
Resolution: Implemented
-
None
-
None
-
None
-
None
Description
Umbrella issue on memory management. One-stop shop to learn how we're doing it, tenets, and work to be done. Collect it all in one place so we are aligned rather than each trying to do it for themselves.
Subtasks include:
+ Map of memory allocation and recycling landscape
+ Where are we allocating when we could be recycling
+ MSLAB and G1GC don't go together?
+ Enable MSLAB pool always?
+ With offheap allocations, less GC but it runs for longer?
+ Better heuristics recycling: e.g. HBASE-15525 OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts
+ See if can do DFSClient buffer reuse: HBASE-15506 FSDataOutputStream.write() allocates new byte buffer on each operation
What else?
Attachments
Attachments
Issue Links
- relates to
-
HBASE-15542 Minimize garbage memory allocations during compaction
-
- Resolved
-
-
-
- Patch Available
-
1.
|
hbase.hregion.memstore.chunkpool.maxsize is 0.0 by default |
|
Closed | Vladimir Rodionov |
2.
|
Remove MemStoreChunkPool? |
|
Resolved | Unassigned |
3.
|
OutOfMemory could occur when using BoundedByteBufferPool during RPC bursts |
|
Closed | Anoop Sam John |
4.
|
Compression Algorithm does not respect config params from hbase-site |
|
Resolved | Unassigned |
5.
|
Avoid copy of block data in HFileBlock$Writer.finishBlock |
|
Closed | Unassigned |
6.
|
See how G1GC works with MSLAB and chunk pool |
|
Resolved | ramkrishna.s.vasudevan |
7.
|
Gc pause increases when the incoming requests are pooled |
|
Resolved | Unassigned |
8.
|
Reduce garbage created by PB in write path |
|
Resolved | Anoop Sam John |
9.
|
MemstoreChunkPool might cross its maxCount of chunks to pool |
|
Resolved | Anoop Sam John |
10.
|
Increase the max number of buffers in ByteBufferPool |
|
Resolved | Anoop Sam John |
11.
|
[offheap] Documentation for max off heap configuration |
|
Resolved | Unassigned |