|
|
|
HDFS-16767
|
HDFS-12943
RBF: Support observer node from Router-Based Federation
|
Simbarashe Dzinamarira
|
Simbarashe Dzinamarira
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-15664
|
HDFS-12943
Prevent Observer NameNode from becoming StandBy NameNode
|
Aihua Xu
|
Aihua Xu
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-14858
|
HDFS-12943
[SBN read] Allow configurably enable/disable AlignmentContext on NameNode
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14822
|
HDFS-12943
[SBN read] Revisit GlobalStateIdContext locking when getting server state id
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14794
|
HDFS-12943
[SBN read] reportBadBlock is rejected by Observer.
|
Unassigned
|
Konstantin Shvachko
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-14792
|
HDFS-12943
[SBN read] StanbyNode does not come out of safemode while adding new blocks.
|
Unassigned
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14785
|
HDFS-12943
[SBN read] Change client logging to be less aggressive
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14779
|
HDFS-12943
Fix logging error in TestEditLog#testMultiStreamsLoadEditWithConfMaxTxns
|
Jonathan Hung
|
Jonathan Hung
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14674
|
HDFS-12943
[SBN read] Got an unexpected txid when tail editlog
|
Zhaohui Wang
|
Zhaohui Wang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14590
|
HDFS-12943
[SBN Read] Add the document link to the top page
|
Takanobu Asanuma
|
Takanobu Asanuma
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14443
|
HDFS-12943
Throwing RemoteException in the time of Read Operation
|
Unassigned
|
Ranith Sardar
|
|
Resolved |
Not A Problem
|
|
|
|
|
|
|
|
HDFS-14270
|
HDFS-12943
[SBN Read] StateId and TrasactionId not present in Trace level logging
|
Shweta
|
Shweta
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14262
|
HDFS-12943
[SBN read] Unclear Log.WARN message in GlobalStateIdContext
|
Shweta
|
Shweta
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14170
|
HDFS-12943
Fix white spaces related to SBN reads.
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14162
|
HDFS-12943
Balancer should work with ObserverNode
|
Erik Krogen
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14160
|
HDFS-12943
ObserverReadInvocationHandler should implement RpcInvocationHandler
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14155
|
HDFS-12943
Update "Consistent Read from Observer" User Guide with Edit Tailing Frequency
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-14154
|
HDFS-12943
Document dfs.ha.tail-edits.period in user guide.
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14149
|
HDFS-12943
Adjust annotations on new interfaces/classes for SBN reads.
|
Chao Sun
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14146
|
HDFS-12943
Handle exception from internalQueueCall
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14142
|
HDFS-12943
Move ipfailover config key out of HdfsClientConfigKeys
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14138
|
HDFS-12943
Description errors in the comparison logic of transaction ID
|
xiangheng
|
xiangheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14131
|
HDFS-12943
Create user guide for "Consistent reads from Observer" feature.
|
Chao Sun
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14130
|
HDFS-12943
Make ZKFC ObserverNode aware
|
xiangheng
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14120
|
HDFS-12943
ORFPP should also clone DT for the virtual IP
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14116
|
HDFS-12943
Fix class cast error in NNThroughputBenchmark with ObserverReadProxyProvider.
|
Chao Sun
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14094
|
HDFS-12943
Fix the order of logging arguments in ObserverReadProxyProvider.
|
Ayush Saxena
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14068
|
HDFS-12943
Allow manual transition from Standby to Observer
|
Unassigned
|
Plamen Jeliazkov
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-14067
|
HDFS-12943
Allow manual failover between standby and observer
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14059
|
HDFS-12943
Test reads from standby on a secure cluster with Configured failover
|
Plamen Jeliazkov
|
Konstantin Shvachko
|
|
Resolved |
Done
|
|
|
|
|
|
|
|
HDFS-14058
|
HDFS-12943
Test reads from standby on a secure cluster with IP failover
|
Chen Liang
|
Konstantin Shvachko
|
|
Resolved |
Done
|
|
|
|
|
|
|
|
HDFS-14035
|
HDFS-12943
NN status discovery does not leverage delegation token
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14020
|
HDFS-12943
Emulate Observer node falling far behind the Active
|
Sherwood Zheng
|
Sherwood Zheng
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-14017
|
HDFS-12943
ObserverReadProxyProviderWithIPFailover should work with HA configuration
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-14016
|
HDFS-12943
ObserverReadProxyProvider should enable observer read by default
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13974
|
HDFS-12943
Introduce the single Observer failure
|
Sherwood Zheng
|
Sherwood Zheng
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-13961
|
HDFS-12943
TestObserverNode refactoring
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13930
|
HDFS-12943
Fix crlf line endings in HDFS-12943 branch
|
Konstantin Shvachko
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13925
|
HDFS-12943
Unit Test for transitioning between different states
|
Sherwood Zheng
|
Sherwood Zheng
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13924
|
HDFS-12943
Handle BlockMissingException when reading from observer
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13923
|
HDFS-12943
Add a configuration to turn on/off observer reads
|
Shweta
|
Chao Sun
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-13898
|
HDFS-12943
Throw retriable exception for getBlockLocations when ObserverNameNode is in safemode
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13880
|
HDFS-12943
Add mechanism to allow certain RPC calls to bypass sync
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13873
|
HDFS-12943
ObserverNode should reject read requests when it is too far behind.
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13872
|
HDFS-12943
Only some protocol methods should perform msync wait
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-13851
|
HDFS-12943
Remove AlignmentContext from AbstractNNFailoverProxyProvider
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13848
|
HDFS-12943
Refactor NameNode failover proxy providers
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13791
|
HDFS-12943
Limit logging frequency of edit tail related statements
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13789
|
HDFS-12943
Reduce logging frequency of QuorumJournalManager#selectInputStreams
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13782
|
HDFS-12943
ObserverReadProxyProvider should work with IPFailoverProxyProvider
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13781
|
HDFS-12943
Unit tests for standby reads.
|
Unassigned
|
Konstantin Shvachko
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-13780
|
HDFS-12943
Postpone NameNode state discovery in ObserverReadProxyProvider until the first real RPC call.
|
Chen Liang
|
Konstantin Shvachko
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-13779
|
HDFS-12943
Implement performFailover logic for ObserverReadProxyProvider.
|
Erik Krogen
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13778
|
HDFS-12943
TestStateAlignmentContextWithHA should use real ObserverReadProxyProvider instead of AlignmentContextProxyProvider.
|
Plamen Jeliazkov
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13767
|
HDFS-12943
Add msync server implementation.
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13749
|
HDFS-12943
Use getServiceStatus to discover observer namenodes
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13706
|
HDFS-12943
ClientGCIContext should be correctly named ClientGSIContext
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13689
|
HDFS-12943
NameNodeRpcServer getEditsFromTxid assumes it is run on active NameNode
|
Unassigned
|
Erik Krogen
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-13688
|
HDFS-12943
Introduce msync API call
|
Chen Liang
|
Chen Liang
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13665
|
HDFS-12943
Move RPC response serialization into Server.doResponse
|
Plamen Jeliazkov
|
Plamen Jeliazkov
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13610
|
HDFS-12943
[Edit Tail Fast Path Pt 4] Cleanup: integration test, documentation, remove unnecessary dummy sync
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13609
|
HDFS-12943
[Edit Tail Fast Path Pt 3] NameNode-side changes to support tailing edits via RPC
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13608
|
HDFS-12943
[Edit Tail Fast Path Pt 2] Add ability for JournalNode to serve edits via RPC
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13607
|
HDFS-12943
[Edit Tail Fast Path Pt 1] Enhance JournalNode with an in-memory cache of recent edit transactions
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13578
|
HDFS-12943
Add ReadOnly annotation to methods in ClientProtocol
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13523
|
HDFS-12943
Support observer nodes in MiniDFSCluster
|
Konstantin Shvachko
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13522
|
HDFS-12943
HDFS-13522: Add federated nameservices states to client protocol and propagate it between routers and clients.
|
Simbarashe Dzinamarira
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13399
|
HDFS-12943
Make Client field AlignmentContext non-static.
|
Plamen Jeliazkov
|
Plamen Jeliazkov
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13331
|
HDFS-12943
Add lastSeenStateId to RpcRequestHeader.
|
Plamen Jeliazkov
|
Plamen Jeliazkov
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13286
|
HDFS-12943
Add haadmin commands to transition between standby and observer
|
Chao Sun
|
Chao Sun
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13189
|
HDFS-12943
Standby NameNode should roll active edit log when checkpointing
|
Unassigned
|
Chao Sun
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-13182
|
HDFS-12943
Allow Observer to participate in NameNode failover
|
Unassigned
|
Chao Sun
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-13152
|
HDFS-12943
Support observer reads for WebHDFS
|
Chao Sun
|
Chao Sun
|
|
Open |
Unresolved
|
|
|
|
|
|
|
|
HDFS-13150
|
HDFS-12943
[Edit Tail Fast Path] Allow SbNN to tail in-progress edits from JN via RPC
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-13122
|
HDFS-12943
Tailing edits should not update quota counts on ObserverNode
|
Erik Krogen
|
Erik Krogen
|
|
Resolved |
Duplicate
|
|
|
|
|
|
|
|
HDFS-12979
|
HDFS-12943
StandbyNode should upload FsImage to ObserverNode after checkpointing.
|
Chen Liang
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-12978
|
HDFS-12943
Fine-grained locking while consuming journal stream.
|
Konstantin Shvachko
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-12977
|
HDFS-12943
Add stateId to RPC headers.
|
Plamen Jeliazkov
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-12976
|
HDFS-12943
Introduce ObserverReadProxyProvider
|
Chao Sun
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|
|
|
|
HDFS-12975
|
HDFS-12943
Changes to the NameNode to support reads from standby
|
Chao Sun
|
Konstantin Shvachko
|
|
Resolved |
Fixed
|
|
|
|
|