[HDFS-4617] warning while purging logs with QJM enabled

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Duplicate
• Affects Version/s: 2.0.3-alpha
• Component/s: ha, namenode, qjm
• Target Version/s: 2.1.0-beta
• Assignee: Unassigned
• Reporter: Todd Lipcon
• Created: 20/Mar/13 05:51
• Updated: 28/Mar/13 04:43
• Resolved: 28/Mar/13 04:43

Description

HDFS-2946 changed the way that edit log purging is calculated, such that it calls selectInputStreams() with an arbitrary transaction ID calculated relative to the current one. The JournalNodes will reject such a request if that transaction ID falls in the middle of a segment (which it usually will). This means that selectInputStreams gets an exception, and the QJM journal manager is not included in this calculation. Additionally, a warning will be logged.

Purging itself still happens, because the detailed information on remote logs is not necessary to calculate a retention interval, but the feature from HDFS-2946 may not work as intended.

Issue Links

• duplicates: HDFS-4298 StorageRetentionManager spews warnings when used with QJM