Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3399

BookKeeper option support for NN HA

Add voteVotersWatch issueWatchersCreate sub-taskLinkCloneUpdate Comment AuthorReplace String in CommentUpdate Comment VisibilityDelete Comments
    XMLWordPrintableJSON

    Details

    • Type: New Feature
    • Status: Reopened
    • Priority: Major
    • Resolution: Unresolved
    • Affects Version/s: 2.0.0-alpha, 3.0.0-alpha1
    • Fix Version/s: None
    • Component/s: ha
    • Labels:
      None

      Description

      Here is the JIRA to BookKeeper support issues with NN HA. We can file all the BookKeeperJournalManager issues under this JIRA for more easy tracking.

        Attachments

        1. BKTestDoc.pdf
          16 kB
          Surendra Singh Lilhore

        Issue Links

        1.
        BK JM : Namenode is not deleting his lock entry '/ledgers/lock/lock-0000X', when fails to acquire the lock Sub-task Resolved Ivan Kelly Actions
        2.
        BookKeeper Journal Manager is not retrying to connect to BK when BookKeeper is not available for write. Sub-task Resolved Unassigned Actions
        3.
        Document the BKJM usage in Namenode HA. Sub-task Closed Uma Maheswara Rao G Actions
        4.
        BKJM : Namenode format fails, if there is no BK root Sub-task Closed Rakesh Radhakrishnan Actions
        5.
        HA: Bring BookKeeperJournalManager up to date with HA changes Sub-task Closed Ivan Kelly Actions
        6.
        BookKeeper Journal output stream doesn't check addComplete rc Sub-task Closed Ivan Kelly Actions
        7.
        BKJM: NN startup is failing, when tries to recoverUnfinalizedSegments() a bad inProgress_ ZNodes Sub-task Closed Ivan Kelly Actions
        8.
        Race condition between rolling logs at active NN and purging at standby Sub-task Closed Rakesh Radhakrishnan Actions
        9.
        BKJM:Switch from standby to active fails and NN gets shut down due to delay in clearing of lock Sub-task Closed Uma Maheswara Rao G Actions
        10.
        BKJM: Deleting currentLedger and leaving 'inprogress_x' on exceptions can throw BKNoSuchLedgerExistsException later. Sub-task Resolved Uma Maheswara Rao G Actions
        11.
        Make BKJM-ZK session timeout configurable. Sub-task Closed Uma Maheswara Rao G Actions
        12.
        Cleanup Exception handling in BookKeeper journal manager Sub-task Closed Ivan Kelly Actions
        13.
        Handle disconnect and session timeout events at BKJM Sub-task Resolved Vinayakumar B Actions
        14.
        BKJM: zkLatchWaitTimeout hard coded to 6000. Make use of ZKSessionTimeout instead. Sub-task Closed Uma Maheswara Rao G Actions
        15.
        BOOTSTRAPSTANDBY for new Standby node will not work just after saveNameSpace at ANN in case of BKJM Sub-task Resolved Rakesh Radhakrishnan Actions
        16.
        Make BKJM use protobufs for all serialization with ZK Sub-task Closed Ivan Kelly Actions
        17.
        Implement format() for BKJM Sub-task Closed Ivan Kelly Actions
        18.
        Implement a fence method which should fence the BK shared storage. Sub-task Resolved Rakesh Radhakrishnan Actions
        19.
        Override toString() for BookKeeperEditLogInputStream Sub-task Closed Vinayakumar B Actions
        20.
        standby namenode become active fails because starting log segment fail on shared storage Sub-task Closed Unassigned Actions
        21.
        In HA mode, when there is a ledger in BK missing, which is generated after the last checkpoint, NN can not restore it. Sub-task Resolved Unassigned Actions
        22.
        BKJM: The reading for editlog at NN starting using bkjm is not efficient Sub-task Closed Han Xiao Actions
        23.
        BKJM: Two namenodes usng bkjm can race to create the version znode Sub-task Resolved Rakesh Radhakrishnan Actions
        24.
        Remove the format limitation point from BKJM documentation as HDFS-3810 closed Sub-task Closed Rakesh Radhakrishnan Actions
        25.
        BKJM doesn't take advantage of speculative reads Sub-task Closed Rakesh Radhakrishnan Actions
        26.
        BKJM: Separate write and ack quorum Sub-task Closed Rakesh Radhakrishnan Actions
        27.
        Changes from BOOKKEEPER-203 broken capability of including bookkeeper-server jar in hidden package of BKJM Sub-task Closed Rakesh Radhakrishnan Actions
        28.
        All BKJM ledgers are not checked while tailing, So failover will fail. Sub-task Closed Vinayakumar B Actions
        29.
        Improve BKJM documentation Sub-task Resolved Rakesh Radhakrishnan Actions
        30.
        TestBookKeeperHACheckpoints fails Sub-task Closed Uma Maheswara Rao G Actions
        31.
        Update Bookkeeper dependency to 4.2.3 Sub-task Closed Rakesh Radhakrishnan Actions

          Activity

            People

            • Assignee:
              Unassigned
              Reporter:
              umamaheswararao Uma Maheswara Rao G

              Dates

              • Created:
                Updated:

                Issue deployment