Bulk Operation

HDFS-3077 QJM: Merge newEpoch and prepareRecovery

HDFS-3077 QJM: Sychronize past log segments to JNs that missed them

HDFS-3077 Unclosed FileInputStream in GetJournalEditServlet

HDFS-3077 TestJournalNode#testJournal fails because of test case execution order

HDFS-3077 QJM: purge temporary files when no longer within retention period

HDFS-3077 QJM: Make acceptRecovery() atomic

HDFS-3077 QJM: misc TODO cleanup, improved log messages, etc

HDFS-3077 QJM: remove currently unused "md5sum" field.

HDFS-3077 QJM: Add JournalNode to the start / stop scripts

HDFS-3077 QJM: Add user documentation for QJM

HDFS-3077 QJM: Failover fails with auth error in secure cluster

HDFS-3077 QJM: acceptRecovery should abort current segment

HDFS-3077 QJM: quorum timeout on failover with large log segment

HDFS-3077 QJM: journalnode does not die/log ERROR when keytab is not found in secure mode

HDFS-3077 QJM: send 'heartbeat' messages to JNs even when they are out-of-sync

HDFS-3077 QJM: avoid validating log segments on log rolls

HDFS-3077 QJM: Writer-side metrics

HDFS-3077 QJM: enable TCP_NODELAY for IPC

HDFS-3077 QJM: testRecoverAfterDoubleFailures can be flaky due to IPC client caching

HDFS-3077 QJM: Make QJM work with security enabled

HDFS-3077 QJM: SBN fails if selectInputStreams throws RTE

HDFS-3077 QJM: optimize log sync when JN is lagging behind

HDFS-3077 QJM: Journal format() should reset cached values

HDFS-3077 QJM: Provide defaults for dfs.journalnode.*address

HDFS-3077 QJM: add metrics to JournalNode

HDFS-3077 QJM: expose non-file journal manager details in web UI

HDFS-3077 QJM: Support rolling restart of JNs

HDFS-3077 QJM: track last "committed" txid

HDFS-3077 QJM: don't require a fencer to be configured if shared storage has built-in single-writer semantics

HDFS-3077 QJM: implement md5sum verification

HDFS-3077 Fixes for edge cases in QJM recovery protocol

HDFS-3077 JournalNodes log JournalNotFormattedException backtrace error before being formatted

HDFS-3077 QJM: hadoop-daemon.sh should be updated to accept "journalnode"

HDFS-3077 QJM: improvements to QJM fault testing

HDFS-3077 QJM: handle empty log segments during recovery

HDFS-3077 Avoid throwing NPE when finalizeSegment() is called on invalid segment

HDFS-3077 QJM: add segment txid as a parameter to journal() RPC

HDFS-3077 QJM: validate journal dir at startup

HDFS-3077 Implement genericized format() in QJM

HDFS-3077 JournalManager#format() should be able to throw IOException

HDFS-3077 QJM: improve formatting behavior for JNs

HDFS-3077 QJM: exhaustive failure injection test for skipped RPCs

HDFS-3077 QJM: if a logger misses an RPC, don't retry that logger until next segment

HDFS-3077 Fix QJM startup when individual JNs have gaps

HDFS-3077 Genericize format() to non-file JournalManagers

HDFS-3077 QJM: Fix getEditLogManifest to fetch httpPort if necessary

HDFS-3077 QJM: JNStorage should read its storage info even before a writer becomes active

HDFS-3077 QJM: support purgeEditLogs() call to remotely purge logs

HDFS-3077 Supply NamespaceInfo when instantiating JournalManagers

HDFS-3077 Allow EditLogFileInputStream to read from a remote URL

HDFS-3077 Active NN should exit when it cannot write to quorum number of Journal Daemons

HDFS-3077 Simple refactors in existing NN code to assist QuorumJournalManager extension

HDFS-3077 Add preliminary QJournalProtocol interface, translators

HDFS-3077 Add infrastructure for waiting for a quorum of ListenableFutures to respond

HDFS-3077 Upgrade guava to 11.0.2

HDFS-3077 Add class to manage JournalList