[GOBBLIN-143] Avoid Manually Adding Deps to bin/gobblin-mapreduce.sh

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Labels: Framework:Build LaunchType:MR enhancement
• External issue URL: https://github.com/linkedin/gobblin/issues/693
• Assignee: Unassigned
• Reporter: Sahil Takiar
• Created: 19/Jul/17 07:40
• Updated: 07/Aug/17 08:59

Description

Currently, any new runtime dependencies required by `Task`s (e.g. anything that runs in a mapper) need manually be added to `bin/gobblin-mapreduce.sh`.

We should find a better way of doing this, so users don't keep on hitting `ClassNotFoundException`s.

Ref: https://github.com/linkedin/gobblin/pull/690, https://github.com/linkedin/gobblin/issues/672

Github Url : https://github.com/linkedin/gobblin/issues/693
Github Reporter : stakiar
Github Created At : 2016-02-10T17:01:32Z
Github Updated At : 2017-01-12T04:39:46Z

Comments

---

stakiar wrote on 2016-03-03T01:22:45Z : This keeps on happening, we should prioritize this: https://github.com/linkedin/gobblin/issues/787

Github Url : https://github.com/linkedin/gobblin/issues/693#issuecomment-191525309