[HDFS-14140] JournalNodeSyncer authentication is failing in secure cluster

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 3.0.0, 3.1.1
• Fix Version/s: 3.3.0, 3.2.1, 3.1.3
• Component/s: journal-node, security
• Assignee: Surendra Singh Lilhore
• Reporter: Surendra Singh Lilhore
• Created: 11/Dec/18 13:28
• Updated: 02/Oct/19 17:14
• Resolved: 08/Feb/19 00:57

Description

2018-12-11 17:25:48,407 | ERROR | org.apache.hadoop.hdfs.qjournal.server.JournalNodeSyncer$$Lambda$31/208830412@42bcafb2 | Download of Edit Log file for Syncing failed. Deleting temp file: /xxxxxxxxxxxxxxxx/edits.sync/edits_0000000000000049016-0000000000000049023 | JournalNodeSyncer.java:464
java.io.IOException: org.apache.hadoop.security.authentication.client.AuthenticationException: Error while authenticating with endpoint: https://xxxxxxxxxx/getJournal?jid=hacluster&segmentTxId=49016&storageInfo=-64%3A716441797%3A1544438882625%3Amyhacluster&inProgressOk=false
	at org.apache.hadoop.hdfs.server.common.Util.doGetUrl(Util.java:160)
	at org.apache.hadoop.hdfs.qjournal.server.JournalNodeSyncer.downloadMissingLogSegment(JournalNodeSyncer.java:460)
	at org.apache.hadoop.hdfs.qjournal.server.JournalNodeSyncer.getMissingLogSegments(JournalNodeSyncer.java:360)
	at org.apache.hadoop.hdfs.qjournal.server.JournalNodeSyncer.syncWithJournalAtIndex(JournalNodeSyncer.java:262)
	at org.apache.hadoop.hdfs.qjournal.server.JournalNodeSyncer.syncJournals(JournalNodeSyncer.java:230)
	at org.apache.hadoop.hdfs.qjournal.server.JournalNodeSyncer.lambda$startSyncJournalsDaemon$0(JournalNodeSyncer.java:190)
	at java.lang.Thread.run(Thread.java:748)

Issue Links

• is depended upon by: HDFS-14261 Kerberize JournalNodeSyncer unit test
• is related to: HDFS-4025 QJM: Sychronize past log segments to JNs that missed them