[OOZIE-1489] Support building and running Oozie on Windows

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Done
• Component/s: build, core, examples, scripts, tests

Environment

Windows

• Assignee: David Wannemacher
• Reporter: David Wannemacher
• Created: 07/Aug/13 17:41
• Updated: 23/Aug/21 08:45
• Resolved: 23/Aug/21 08:45

Description

There are several issues that prevent Oozie from working on Windows natively (without Cygwin):

1. Unix OS is enforced in the build.
2. Platform-specific assumptions for file path formats. For example, assuming that forward slash is a valid path separator.
3. Workarounds required for windows-specific issues. For example, environment variables referring to file paths are enclosed in double quotes, which need to be removed prior to using them.
4. Unit tests make many platform-specific assumptions that break on windows.
5. .sh scripts need to be ported to .cmd/.ps1.

Microsoft and Hortonworks have addressed these issues in a series of patches, which will now be ported to Apache Oozie trunk and submitted to the community for review. These patches will be attached in subtasks of this top-level Jira.

I will also document the assumptions and steps that are needed to build on Windows. One such assumption is that running unit tests require hadoop core built from branch-1-win.

Issue Links

• incorporates: OOZIE-1763 ooziedb command could fail on Windows

Sub-Tasks

• Remove unix OS enforcement from build: Closed
• Fix many OS-specific issues on Windows: Closed
• Support using MS SQL Server as a metastore: Closed
• Create Windows versions of the shell scripts: Closed
• Bring Windows shell script functionality and structure in line with trunk: Closed