Uploaded image for project: 'Hadoop HDFS'
  1. Hadoop HDFS
  2. HDFS-3077 Quorum-based protocol for reading and writing edit logs
  3. HDFS-3692

QJM: support purgeEditLogs() call to remotely purge logs

        Details

        • Type: Sub-task
        • Status: Resolved
        • Priority: Major
        • Resolution: Fixed
        • Affects Version/s: QuorumJournalManager (HDFS-3077)
        • Fix Version/s: QuorumJournalManager (HDFS-3077)
        • Component/s: namenode
        • Labels:
          None

          Description

          This API is currently marked TODO. We need it to maintain bounded disk space usage on the JournalNode storage.

          1. Text File
            hdfs-3692.txt
            19 kB
            Todd Lipcon

            Activity

            Ascending order - Click to sort in descending order
            Hide
            Permalink
            tlipcon Todd Lipcon added a comment -

            Attached patch implements purgeEditLogs() by RPCing to the JNs. It's asynchronous (i.e we don't wait for a quorum), but that's OK because this is just a cleanup method. If it fails, we'll purge those entries next time.

            Show
            tlipcon Todd Lipcon added a comment - Attached patch implements purgeEditLogs() by RPCing to the JNs. It's asynchronous (i.e we don't wait for a quorum), but that's OK because this is just a cleanup method. If it fails, we'll purge those entries next time.
            Hide
            Permalink
            atm Aaron T. Myers added a comment -

            +1, the patch looks good to me.

            Show
            atm Aaron T. Myers added a comment - +1, the patch looks good to me.
            Hide
            Permalink
            tlipcon Todd Lipcon added a comment -

            Committed to branch, thanks for the review.

            Show
            tlipcon Todd Lipcon added a comment - Committed to branch, thanks for the review.

              People

              • Assignee:
                tlipcon Todd Lipcon
                Reporter:
                tlipcon Todd Lipcon
              • Votes:
                0 Vote for this issue
                Watchers:
                4 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved:

                  Development