[HADOOP-13397] Add dockerfile for Hadoop

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Assignee: Unassigned
• Reporter: Klaus Ma
• Created: 21/Jul/16 09:36
• Updated: 01/Sep/18 20:05

Description

For now, there's no community version Dockerfile in Hadoop; most of docker images are provided by vendor, e.g.

1. Cloudera's image: https://hub.docker.com/r/cloudera/quickstart/
2. From HortonWorks sequenceiq: https://hub.docker.com/r/sequenceiq/hadoop-docker/
3. MapR provides the mapr-sandbox-base: https://hub.docker.com/r/maprtech/mapr-sandbox-base/

The proposal of this JIRA is to provide a community version Dockerfile in Hadoop, and here's some requirement:

1. Seperated docker image for master & agents, e.g. resource manager & node manager
2. Default configuration to start master & agent instead of configurating manually
3. Start Hadoop process as no-daemon

Here's my dockerfile to start master/agent: https://github.com/k82cn/outrider/tree/master/kubernetes/imgs/yarn
I'd like to contribute it after polishing .

Email Thread : http://mail-archives.apache.org/mod_mbox/hadoop-user/201607.mbox/%3CSG2PR04MB162977CFE150444FA022510FB6370%40SG2PR04MB1629.apcprd04.prod.outlook.com%3E

Issue Links

• is related to: HBASE-12721 Create Docker container cluster infrastructure to enable better testing
• is related to: LEGAL-270 Official Docker Image support in ASF project
• requires: HADOOP-13673 Update scripts to be smarter when running with privilege