|
|
|
HDFS-2174
|
HDFS-1073
Complete decoupling of failure states between edits and image dirs
|
Unassigned
|
Todd Lipcon
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-2173
|
HDFS-1073
saveNamespace should not throw IOE when only one storage directory fails to write VERSION file
|
Andras Bokor
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2172
|
HDFS-1073
1073: address findbugs/javadoc warnings
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2170
|
HDFS-1073
1073: Address remaining TODOs
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2169
|
HDFS-1073
1073: clean up TestCheckpoint and remove TODOs
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2168
|
HDFS-1073
1073: Reenable TestEditLog.testFailedOpen and fix exposed bug
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2160
|
HDFS-1073
1073: fix CreateEditsLog test tool in branch
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2136
|
HDFS-1073
1073: Fault injection for StorageDirectory failures during read/write of FSImage/Edits files
|
Unassigned
|
Matthew Foley
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-2135
|
HDFS-1073
1073: fix regression of HDFS-1955 in branch
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2133
|
HDFS-1073
1073: address remaining TODOs and pre-merge cleanup
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2123
|
HDFS-1073
1073: Checkpoint interval should be based on txn count, not size
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2104
|
HDFS-1073
1073: Add a flag to 2NN to format its checkpoint dirs on startup
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2102
|
HDFS-1073
1073: Zero pad edits filename to make them lexically sortable
|
Ivan Kelly
|
Ivan Kelly
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2101
|
HDFS-1073
1073: update remaining unit tests to new storage filenames
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2099
|
HDFS-1073
1073: consider adding END_LOG_SEGMENT txn when finalizing inprogress logs at startup
|
Unassigned
|
Todd Lipcon
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-2093
|
HDFS-1073
1073: Handle case where an entirely empty log is left during NN crash
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2088
|
HDFS-1073
1073: Move edits log archiving logic into FSEditLog/JournalManager
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2085
|
HDFS-1073
1073: finalize inprogress edit logs at startup
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2079
|
HDFS-1073
1073: create an escape hatch to ignore startup consistency problems
|
Colin McCabe
|
Todd Lipcon
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-2078
|
HDFS-1073
1073: NN should not clear storage directory when restoring removed storage
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2077
|
HDFS-1073
1073: address checkpoint upload when one of the storage dirs is failed
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2074
|
HDFS-1073
1073: determine edit log validity by truly reading and validating transactions
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2048
|
HDFS-1073
1073: Improve upgrade tests from 0.22
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2047
|
HDFS-1073
1073: Improve TestNamespace and TestEditLog in 1073 branch
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2027
|
HDFS-1073
1073: Image inspector should return finalized logs before unfinalized logs
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2026
|
HDFS-1073
1073: 2NN needs to handle case of reformatted NN better
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2018
|
HDFS-1073
1073: Move all journal stream management code into one place
|
Ivan Kelly
|
Ivan Kelly
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-2016
|
HDFS-1073
1073: remove/archive unneeded/old storage files
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2015
|
HDFS-1073
1073: Remove checkpointTxId from VERSION file
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2010
|
HDFS-1073
Clean up and test behavior under failed edit streams
|
Aaron Myers
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-2001
|
HDFS-1073
HDFS-1073: Kill previous.checkpoint, lastcheckpoint.tmp directories
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1997
|
HDFS-1073
Image transfer process misreports client side exceptions
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1994
|
HDFS-1073
Fix race conditions when running two rapidly checkpointing 2NNs
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1993
|
HDFS-1073
TestCheckpoint needs to clean up between cases
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1992
|
HDFS-1073
Remove vestiges of NNStorageListener
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1991
|
HDFS-1073
HDFS-1073: Some refactoring of 2NN to easier share code with BN and CN
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1987
|
HDFS-1073
HDFS-1073: Test for 2NN downloading image is not running
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1985
|
HDFS-1073
HDFS-1073: Cleanup in image transfer servlet
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1984
|
HDFS-1073
1073: Enable multiple checkpointers to run simultaneously
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1979
|
HDFS-1073
HDFS-1073: Fix backupnode for new edits/image layout
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1930
|
HDFS-1073
TestDFSUpgrade failing in HDFS-1073 branch
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1926
|
HDFS-1073
Remove references to StorageDirectory from JournalManager interface
|
Ivan Kelly
|
Ivan Kelly
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1896
|
HDFS-1073
Additional QA tasks for Edit Log branch
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Not A Problem
|
|
|
|
|
|
|
|
HDFS-1894
|
HDFS-1073
Add constants for LAYOUT_VERSIONs in edits log branch
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1893
|
HDFS-1073
Change edit logs and images to be named based on txid
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1892
|
HDFS-1073
Update HDFS-1073 branch to deal with OP_INVALID-filled preallocation
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1859
|
HDFS-1073
Add some convenience functions to iterate over edit log streams
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1858
|
HDFS-1073
Add state management variables to FSEditLog
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1815
|
HDFS-1073
Add migration tests from old-format to new-format storage
|
Unassigned
|
Todd Lipcon
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-1801
|
HDFS-1073
Remove use of timestamps to identify checkpoints and logs
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1800
|
HDFS-1073
Extend image checksumming to function with multiple fsimage files
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1799
|
HDFS-1073
Refactor log rolling and filename management out of FSEditLog
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1794
|
HDFS-1073
Add code to list which edit logs are available on a remote NN
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1793
|
HDFS-1073
Add code to inspect a storage directory with txid-based filenames
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1792
|
HDFS-1073
Add code to detect valid length of an edits file
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1780
|
HDFS-1073
reduce need to rewrite fsimage on statrtup
|
Todd Lipcon
|
Daryn Sharp
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1538
|
HDFS-1073
Refactor more startup and image loading code out of FSImage
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1521
|
HDFS-1073
Persist transaction ID on disk between NN restarts
|
Todd Lipcon
|
Todd Lipcon
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-1473
|
HDFS-1073
Refactor storage management into separate classes than fsimage file reading/writing
|
Todd Lipcon
|
Todd Lipcon
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-1462
|
HDFS-1073
Refactor edit log loading to a separate class from edit log writing
|
Todd Lipcon
|
Todd Lipcon
|
|
Closed |
Fixed
|
|
|
|
|
|
|
|
HDFS-259
|
HDFS-1073
Remove intentionally corrupt 0.13 directory layout creation
|
Todd Lipcon
|
Todd Lipcon
|
|
Closed |
Fixed
|
|
|
|
|