Details

    • Type: New Feature New Feature
    • Status: Reopened
    • Priority: Major Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0-alpha, 3.0.0
    • Fix Version/s: None
    • Component/s: ha
    • Labels:
      None

      Description

      Here is the JIRA to BookKeeper support issues with NN HA. We can file all the BookKeeperJournalManager issues under this JIRA for more easy tracking.

      1. BKTestDoc.pdf
        16 kB
        surendra singh lilhore

        Issue Links

        1.
        BK JM : Namenode is not deleting his lock entry '/ledgers/lock/lock-0000X', when fails to acquire the lock Sub-task Resolved Ivan Kelly
         
        2.
        BookKeeper Journal Manager is not retrying to connect to BK when BookKeeper is not available for write. Sub-task Resolved Unassigned
         
        3.
        Document the BKJM usage in Namenode HA. Sub-task Closed Uma Maheswara Rao G
         
        4.
        BKJM : Namenode format fails, if there is no BK root Sub-task Closed Rakesh R
         
        5.
        HA: Bring BookKeeperJournalManager up to date with HA changes Sub-task Closed Ivan Kelly
         
        6.
        BookKeeper Journal output stream doesn't check addComplete rc Sub-task Closed Ivan Kelly
         
        7.
        BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes Sub-task Closed Ivan Kelly
         
        8.
        Race condition between rolling logs at active NN and purging at standby Sub-task Closed Rakesh R
         
        9.
        BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock Sub-task Closed Uma Maheswara Rao G
         
        10.
        BKJM: Deleting currentLedger and leaving 'inprogress_x' on exceptions can throw BKNoSuchLedgerExistsException later. Sub-task Resolved Uma Maheswara Rao G
         
        11.
        Make BKJM-ZK session timeout configurable. Sub-task Closed Uma Maheswara Rao G
         
        12.
        Cleanup Exception handling in BookKeeper journal manager Sub-task Closed Ivan Kelly
         
        13. Handle disconnect and session timeout events at BKJM Sub-task Patch Available Vinayakumar B
         
        14.
        BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Sub-task Closed Uma Maheswara Rao G
         
        15. BOOTSTRAPSTANDBY for new Standby node will not work just after saveNameSpace at ANN in case of BKJM Sub-task Open Rakesh R
         
        16.
        Make BKJM use protobufs for all serialization with ZK Sub-task Closed Ivan Kelly
         
        17.
        Implement format() for BKJM Sub-task Closed Ivan Kelly
         
        18. Implement a fence method which should fence the BK shared storage. Sub-task Open Unassigned
         
        19.
        Override toString() for BookKeeperEditLogInputStream Sub-task Closed Vinayakumar B
         
        20.
        standby namenode become active fails because starting log segment fail on shared storage Sub-task Closed Unassigned
         
        21. In HA mode, when there is a ledger in BK missing, which is generated after the last checkpoint, NN can not restore it. Sub-task Open Unassigned
         
        22.
        BKJM: The reading for editlog at NN starting using bkjm is not efficient Sub-task Closed Han Xiao
         
        23. BKJM: Two namenodes usng bkjm can race to create the version znode Sub-task Patch Available Han Xiao
         
        24.
        Remove the format limitation point from BKJM documentation as HDFS-3810 closed Sub-task Resolved Rakesh R
         
        25. BKJM doesn't take advantage of speculative reads Sub-task Patch Available Rakesh R
         
        26. BKJM: Separate write and ack quorum Sub-task Patch Available Rakesh R
         
        27.
        Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM Sub-task Resolved Rakesh R
         
        28.
        All BKJM ledgers are not checked while tailing, So failover will fail. Sub-task Closed Vinayakumar B
         
        29. Improve BKJM documentation Sub-task Open Unassigned
         
        30.
        TestBookKeeperHACheckpoints fails Sub-task Closed Uma Maheswara Rao G
         
        31.
        Update Bookkeeper dependency to 4.2.3 Sub-task Resolved Rakesh R
         

          Activity

          Uma Maheswara Rao G created issue -
          Uma Maheswara Rao G made changes -
          Field Original Value New Value
          Link This issue depends upon HDFS-234 [ HDFS-234 ]
          Hide
          Uma Maheswara Rao G added a comment -

          This is what i have committed. Resolved the TestBookKeeperJournalManager conflicts with HDFS-3423 and removed one unused import ArrayList in TestBookKeeperJournalManager.

          Show
          Uma Maheswara Rao G added a comment - This is what i have committed. Resolved the TestBookKeeperJournalManager conflicts with HDFS-3423 and removed one unused import ArrayList in TestBookKeeperJournalManager.
          Uma Maheswara Rao G made changes -
          Attachment HDFS-3441.3.patch [ 12530440 ]
          Hide
          Uma Maheswara Rao G added a comment -

          I have committed this to trunk and branch-2. Thanks a lot, Rakesh for the patch.
          Thanks a lot, Ivan for the reviews!

          Show
          Uma Maheswara Rao G added a comment - I have committed this to trunk and branch-2. Thanks a lot, Rakesh for the patch. Thanks a lot, Ivan for the reviews!
          Uma Maheswara Rao G made changes -
          Status Open [ 1 ] Resolved [ 5 ]
          Hadoop Flags Reviewed [ 10343 ]
          Fix Version/s 2.0.1-alpha [ 12321440 ]
          Fix Version/s 3.0.0 [ 12320356 ]
          Resolution Fixed [ 1 ]
          Uma Maheswara Rao G made changes -
          Resolution Fixed [ 1 ]
          Status Resolved [ 5 ] Reopened [ 4 ]
          Uma Maheswara Rao G made changes -
          Attachment HDFS-3441.3.patch [ 12530440 ]
          Hide
          Uma Maheswara Rao G added a comment -

          Above comments are for HDFS-3441. Accidentally I have commented here.

          Show
          Uma Maheswara Rao G added a comment - Above comments are for HDFS-3441 . Accidentally I have commented here.
          Uma Maheswara Rao G made changes -
          Fix Version/s 3.0.0 [ 12320356 ]
          Fix Version/s 2.0.1-alpha [ 12321440 ]
          Hide
          surendra singh lilhore added a comment -

          Attached test scenarios which we have performed with BKJM and BK in NN HA.

          Show
          surendra singh lilhore added a comment - Attached test scenarios which we have performed with BKJM and BK in NN HA.
          surendra singh lilhore made changes -
          Attachment BKTestDoc.pdf [ 12538911 ]
          Uma Maheswara Rao G made changes -
          Link This issue is required by HDFS-1623 [ HDFS-1623 ]
          Uma Maheswara Rao G made changes -
          Link This issue is required by HDFS-1623 [ HDFS-1623 ]
          Uma Maheswara Rao G made changes -
          Link This issue is related to HDFS-1623 [ HDFS-1623 ]
          Uma Maheswara Rao G made changes -
          Priority Major [ 3 ] Minor [ 4 ]
          Uma Maheswara Rao G made changes -
          Priority Minor [ 4 ] Major [ 3 ]

            People

            • Assignee:
              Unassigned
              Reporter:
              Uma Maheswara Rao G
            • Votes:
              0 Vote for this issue
              Watchers:
              22 Start watching this issue

              Dates

              • Created:
                Updated:

                Development