|
|
|
HDFS-10328
|
HDFS-4949
Add per-cache-pool default replication num configuration
|
xupeng
|
xupeng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5708
|
HDFS-4949
The CacheManager throws a NPE in the DataNode logs when processing cache reports that refer to a block not known to the BlockManager
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5651
|
HDFS-4949
Remove dfs.namenode.caching.enabled and improve CRM locking
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5636
|
HDFS-4949
Enforce a max TTL per cache pool
|
Andrew Wang
|
Andrew Wang
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5634
|
HDFS-4949
allow BlockReaderLocal to switch between checksumming and not
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5630
|
HDFS-4949
Hook up cache directive and pool usage statistics
|
Andrew Wang
|
Andrew Wang
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5589
|
HDFS-4949
Namenode loops caching and uncaching when data should be uncached
|
Andrew Wang
|
Andrew Wang
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5565
|
HDFS-4949
CacheAdmin help should match against non-dashed commands
|
Andrew Wang
|
Andrew Wang
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5564
|
HDFS-4949
Refactor tests in TestCacheDirectives
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-5556
|
HDFS-4949
add some more NameNode cache statistics, cache pool stats
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5551
|
HDFS-4949
Rename "path.based" caching configuration options
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Won't Fix
|
|
|
|
|
|
|
|
HDFS-5543
|
HDFS-4949
fix narrow race condition in TestPathBasedCacheRequests
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5521
|
HDFS-4949
skip checksums when reading a cached block via non-local reads
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Won't Fix
|
|
|
|
|
|
|
|
HDFS-5520
|
HDFS-4949
loading cache path directives from edit log doesn't update nextEntryId
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5511
|
HDFS-4949
improve CacheManipulator interface to allow better unit testing
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5509
|
HDFS-4949
TestPathBasedCacheRequests#testReplicationFactor is flaky
|
Andrew Wang
|
Andrew Wang
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5507
|
HDFS-4949
Consider maximum DN memory, stale status when scheduling recaching
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-5485
|
HDFS-4949
add command-line support for modifyDirective
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5473
|
HDFS-4949
Consistent naming of user-visible caching classes and methods
|
Colin McCabe
|
Andrew Wang
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5451
|
HDFS-4949
Add byte and file statistics to PathBasedCacheEntry
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5450
|
HDFS-4949
better API for getting the cached blocks locations
|
Andrew Wang
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5431
|
HDFS-4949
support cachepool-based limit management in path-based caching
|
Andrew Wang
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5430
|
HDFS-4949
Support TTL on CacheDirectives
|
Andrew Wang
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5419
|
HDFS-4949
Fixup test-patch.sh warnings on HDFS-4949 branch
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5405
|
HDFS-4949
Fix possible RetryCache hang for caching RPC handlers in FSNamesystem
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5404
|
HDFS-4949
Resolve regressions in Windows compatibility on HDFS-4949 branch.
|
Chris Nauroth
|
Chris Nauroth
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5394
|
HDFS-4949
fix race conditions in DN caching and uncaching
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5388
|
HDFS-4949
Loading fsimage fails to find cache pools during namenode startup.
|
Chris Nauroth
|
Chris Nauroth
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5386
|
HDFS-4949
Add feature documentation for datanode caching.
|
Colin McCabe
|
Chris Nauroth
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5385
|
HDFS-4949
Caching RPCs are AtMostOnce, but do not persist client ID and call ID to edit log.
|
Chris Nauroth
|
Chris Nauroth
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5383
|
HDFS-4949
fix broken caching unit tests
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5378
|
HDFS-4949
In CacheReport, don't send genstamp and length on the wire
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5366
|
HDFS-4949
recaching improvements
|
Colin McCabe
|
Colin McCabe
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5359
|
HDFS-4949
Allow LightWeightGSet#Iterator to remove elements
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5358
|
HDFS-4949
Add replication field to PathBasedCacheDirective
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5349
|
HDFS-4949
DNA_CACHE and DNA_UNCACHE should be by blockId only
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5348
|
HDFS-4949
Fix error message when dfs.datanode.max.locked.memory is improperly configured
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5326
|
HDFS-4949
add modifyDirective to cacheAdmin
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5320
|
HDFS-4949
Add datanode caching metrics
|
Andrew Wang
|
Andrew Wang
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-5314
|
HDFS-4949
Do not expose CachePool type in AddCachePoolOp
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5309
|
HDFS-4949
Fix failing caching unit tests
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5304
|
HDFS-4949
Expose if a block replica is cached in getFileBlockLocations
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5253
|
HDFS-4949
Add requesting user's name to PathBasedCacheEntry
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Incomplete
|
|
|
|
|
|
|
|
HDFS-5236
|
HDFS-4949
Change PathBasedCacheDirective APIs to be a single value rather than batch
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5224
|
HDFS-4949
Refactor PathBasedCache* methods to use a Path rather than a String
|
Chris Nauroth
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5213
|
HDFS-4949
separate PathBasedCacheEntry and PathBasedCacheDirectiveWithId
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5210
|
HDFS-4949
Fix some failing unit tests on HDFS-4949 branch
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5203
|
HDFS-4949
Concurrent clients that add a cache directive on the same path may prematurely uncache from each other.
|
Chris Nauroth
|
Chris Nauroth
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5201
|
HDFS-4949
NativeIO: consolidate getrlimit into NativeIO#getMemlockLimit
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5198
|
HDFS-4949
NameNodeRpcServer must not send back DNA_FINALIZE in reply to a cache report
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5191
|
HDFS-4949
revisit zero-copy API in FSDataInputStream to make it more intuitive
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5190
|
HDFS-4949
Move cache pool related CLI commands to CacheAdmin
|
Andrew Wang
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5173
|
HDFS-4949
prettier dfsadmin -listCachePools output
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-5166
|
HDFS-4949
caching PB cleanups
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-5163
|
HDFS-4949
miscellaneous cache pool RPC fixes
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5158
|
HDFS-4949
add command-line support for manipulating cache directives
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5149
|
HDFS-4949
Support for federated cache pools
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Incomplete
|
|
|
|
|
|
|
|
HDFS-5141
|
HDFS-4949
Add cache status information to datanode heartbeat
|
Andrew Wang
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5121
|
HDFS-4949
add RPCs for creating and manipulating cache pools
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5120
|
HDFS-4949
add command-line support for manipulating cache pools
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5119
|
HDFS-4949
Persist CacheManager state in the edit log
|
Andrew Wang
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5096
|
HDFS-4949
Automatically cache new data added to a cached path
|
Colin McCabe
|
Andrew Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5053
|
HDFS-4949
NameNode should invoke DataNode APIs to coordinate caching
|
Andrew Wang
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5052
|
HDFS-4949
Add cacheRequest/uncacheRequest support to NameNode
|
Colin McCabe
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5051
|
HDFS-4949
Propagate cache status information from the DataNode to the NameNode
|
Andrew Wang
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5050
|
HDFS-4949
Add DataNode support for mlock and munlock
|
Andrew Wang
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-5049
|
HDFS-4949
Add JNI mlock support
|
Andrew Wang
|
Colin McCabe
|
|
Resolved |
Fixed
|
|
|
|
|