Details
-
Bug
-
Status: Resolved
-
Major
-
Resolution: Not A Problem
-
None
-
None
Description
Found this while trying to run a local job runner out of the box for development testing.
The MapReduceSubmissionEngine looks in /etc/hadoop/conf for hadoop configurations. When trying to run a local job runner without an actual hadoop install, this forces the user to create an /etc/hadoop/conf directory, and then put a lot of configs in there to get local job runner to work.
Proposing a change to use hadoop defaults (comes with Hadoop Configuration object), which will make local job runner work out of the box. Though, empty /etc/hadoop/conf directory still needs to be created.