[FLUME-2032] HDFSEventSink doesn't work in Windows

• Type: Bug
• Status: Resolved
• Priority: Trivial
• Resolution: Fixed
• Affects Version/s: 1.3.0
• Fix Version/s: 1.4.0
• Component/s: Sinks+Sources, Windows

Environment

Windows.

• Assignee: Pedro Urbina Escos
• Reporter: Pedro Urbina Escos
• Created: 02/May/13 07:04
• Updated: 14/Jun/13 02:22
• Resolved: 14/Jun/13 00:25

Description

Fix for FLUME-1373 (Remove hardcoded file separator in HDFSEventSink ) regressed the HDFS in Windows. The fix was done per PMD/Findbugs alert. The fix was to replace '/' with the OS file separator. The problem is that the code is not trying to build a local path; it's trying to combine strings to form a URI. In Linux, OS separator is '/' and this is not a problem. In windows, OS separator is '\' and therefore you end up with paths like hdfs://foo\var. The best fix would be to use URL objects but new URL("hdfs://..") throws unknown protocol HDFS. The most cost effective fix seems to be revert to hardcoding '/'