Mesos
  1. Mesos
  2. MESOS-148

Building of included Hadoop broken

    Details

    • Type: Bug Bug
    • Status: Resolved
    • Priority: Major Major
    • Resolution: Fixed
    • Affects Version/s: 0.9.0
    • Fix Version/s: 0.10.0
    • Component/s: framework
    • Labels:
      None
    • Environment:

      OSX 10.6.8

      Description

      When I run ant on the included Hadoop, I get the following error:

      [javac] Compiling 8 source files to /Users/thomas/mesos2/frameworks/hadoop-0.20.2/build/contrib/mesos/classes
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:16: package org.apache.mesos does not exist
      [javac] import org.apache.mesos.Executor;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:17: package org.apache.mesos does not exist
      [javac] import org.apache.mesos.ExecutorDriver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:18: package org.apache.mesos does not exist
      [javac] import org.apache.mesos.MesosExecutorDriver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:19: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.ExecutorArgs;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:20: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.ExecutorID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:21: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.SlaveID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:22: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:23: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskDescription;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:24: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskState;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:25: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskStatus;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:27: cannot find symbol
      [javac] symbol: class Executor
      [javac] public class FrameworkExecutor implements Executor {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:37: cannot find symbol
      [javac] symbol : class ExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] private ExecutorDriver driver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:38: cannot find symbol
      [javac] symbol : class SlaveID
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] private SlaveID slaveId;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:45: cannot find symbol
      [javac] symbol : class ExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void init(ExecutorDriver d, ExecutorArgs args) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:45: cannot find symbol
      [javac] symbol : class ExecutorArgs
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void init(ExecutorDriver d, ExecutorArgs args) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:82: cannot find symbol
      [javac] symbol : class ExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void launchTask(ExecutorDriver d, TaskDescription task) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:82: cannot find symbol
      [javac] symbol : class TaskDescription
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void launchTask(ExecutorDriver d, TaskDescription task) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:92: cannot find symbol
      [javac] symbol : class ExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void killTask(ExecutorDriver d, TaskID taskId) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:98: cannot find symbol
      [javac] symbol : class ExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void frameworkMessage(ExecutorDriver d, byte[] msg) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:153: cannot find symbol
      [javac] symbol : class ExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void error(ExecutorDriver d, int code, String msg) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:158: cannot find symbol
      [javac] symbol : class ExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] public void shutdown(ExecutorDriver d) {}
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:22: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.ExecutorInfo;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:23: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.ExecutorID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:24: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.FrameworkID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:25: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.OfferID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:26: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.Resource;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:27: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.SlaveID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:28: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.Offer;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:29: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskID;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:30: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskDescription;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:31: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskState;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:32: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.TaskStatus;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:33: package org.apache.mesos.Protos does not exist
      [javac] import org.apache.mesos.Protos.Status;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:34: package org.apache.mesos does not exist
      [javac] import org.apache.mesos.Scheduler;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:35: package org.apache.mesos does not exist
      [javac] import org.apache.mesos.SchedulerDriver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:37: cannot find symbol
      [javac] symbol: class Scheduler
      [javac] public class FrameworkScheduler implements Scheduler {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/MesosScheduler.java:8: package org.apache.mesos does not exist
      [javac] import org.apache.mesos.MesosSchedulerDriver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/MesosScheduler.java:9: package org.apache.mesos does not exist
      [javac] import org.apache.mesos.SchedulerDriver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:102: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private SchedulerDriver driver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:104: cannot find symbol
      [javac] symbol : class FrameworkID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private FrameworkID frameworkId;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:153: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void registered(SchedulerDriver d, FrameworkID fid) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:153: cannot find symbol
      [javac] symbol : class FrameworkID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void registered(SchedulerDriver d, FrameworkID fid) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:165: cannot find symbol
      [javac] symbol : class Resource
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private static Resource makeResource(String name, double value) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:171: cannot find symbol
      [javac] symbol : class Resource
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private static double getResource(Collection<Resource> resources, String name) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:180: cannot find symbol
      [javac] symbol : class Offer
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private static double getResource(Offer offer, String name) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:184: cannot find symbol
      [javac] symbol : class TaskDescription
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private static double getResource(TaskDescription task, String name) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:189: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void resourceOffers(SchedulerDriver d, List<Offer> offers) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:189: cannot find symbol
      [javac] symbol : class Offer
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void resourceOffers(SchedulerDriver d, List<Offer> offers) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:249: cannot find symbol
      [javac] symbol : class SlaveID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private TaskTrackerInfo getTaskTrackerInfo(String host, SlaveID slaveId) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:261: cannot find symbol
      [javac] symbol : class SlaveID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] SlaveID slaveId, String host, double cpus, double mem) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:260: cannot find symbol
      [javac] symbol : class TaskDescription
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private TaskDescription findTask(
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:326: cannot find symbol
      [javac] symbol : class ExecutorID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private static final ExecutorID EXECUTOR_ID =
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:329: cannot find symbol
      [javac] symbol : class ExecutorInfo
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public ExecutorInfo getExecutorInfo() {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:454: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void statusUpdate(SchedulerDriver d, TaskStatus status) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:469: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void slaveLost(SchedulerDriver d, SlaveID slaveId) {}
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:469: cannot find symbol
      [javac] symbol : class SlaveID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void slaveLost(SchedulerDriver d, SlaveID slaveId) {}
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:580: cannot find symbol
      [javac] symbol : class TaskState
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] private void askExecutorToUpdateStatus(MesosTask nt, TaskState state) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:625: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void frameworkMessage(SchedulerDriver d, SlaveID sId, ExecutorID eId, byte[] message) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:625: cannot find symbol
      [javac] symbol : class SlaveID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void frameworkMessage(SchedulerDriver d, SlaveID sId, ExecutorID eId, byte[] message) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:625: cannot find symbol
      [javac] symbol : class ExecutorID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void frameworkMessage(SchedulerDriver d, SlaveID sId, ExecutorID eId, byte[] message) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:630: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void error(SchedulerDriver d, int code, String msg) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:635: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void offerRescinded(SchedulerDriver d, OfferID oId) {}
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:635: cannot find symbol
      [javac] symbol : class OfferID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] public void offerRescinded(SchedulerDriver d, OfferID oId) {}
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/MesosScheduler.java:26: cannot find symbol
      [javac] symbol : class SchedulerDriver
      [javac] location: class org.apache.hadoop.mapred.MesosScheduler
      [javac] private SchedulerDriver driver;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:67: cannot find symbol
      [javac] symbol : class SlaveID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler.TaskTrackerInfo
      [javac] SlaveID mesosSlaveId;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:71: cannot find symbol
      [javac] symbol : class SlaveID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler.TaskTrackerInfo
      [javac] public TaskTrackerInfo(SlaveID mesosSlaveId) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:44: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:87: cannot find symbol
      [javac] symbol : variable TaskState
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] .setState(TaskState.TASK_RUNNING)
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:85: cannot find symbol
      [javac] symbol : method newBuilder()
      [javac] location: class org.apache.hadoop.mapred.TaskStatus
      [javac] d.sendStatusUpdate(TaskStatus.newBuilder()
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:81: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:91: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:103: cannot find symbol
      [javac] symbol : class TaskState
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] TaskState s = TaskState.valueOf(hfm.arg1);
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:103: cannot find symbol
      [javac] symbol : variable TaskState
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] TaskState s = TaskState.valueOf(hfm.arg1);
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:107: cannot find symbol
      [javac] symbol : method newBuilder()
      [javac] location: class org.apache.hadoop.mapred.TaskID
      [javac] TaskID.newBuilder().setValue(hfm.arg2).build()
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:106: cannot find symbol
      [javac] symbol : method newBuilder()
      [javac] location: class org.apache.hadoop.mapred.TaskStatus
      [javac] TaskStatus.newBuilder().setTaskId(
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:97: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:133: package org.apache.mesos.Protos does not exist
      [javac] org.apache.mesos.Protos.TaskState mesosState = null;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:135: cannot find symbol
      [javac] symbol : variable TaskState
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] mesosState = TaskState.TASK_FINISHED;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:137: cannot find symbol
      [javac] symbol : variable TaskState
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] mesosState = TaskState.TASK_FAILED;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:139: cannot find symbol
      [javac] symbol : variable TaskState
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] mesosState = TaskState.TASK_KILLED;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:143: cannot find symbol
      [javac] symbol : method newBuilder()
      [javac] location: class org.apache.hadoop.mapred.TaskID
      [javac] TaskID.newBuilder().setValue(task.extraData).build()
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:142: cannot find symbol
      [javac] symbol : method newBuilder()
      [javac] location: class org.apache.hadoop.mapred.TaskStatus
      [javac] TaskStatus.newBuilder().setTaskId(
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:152: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:157: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkExecutor.java:162: cannot find symbol
      [javac] symbol : class MesosExecutorDriver
      [javac] location: class org.apache.hadoop.mapred.FrameworkExecutor
      [javac] new MesosExecutorDriver(instance).run();
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:152: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:168: package Resource does not exist
      [javac] ).setType(Resource.Type.SCALAR).build();
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:167: package Resource does not exist
      [javac] Resource.Scalar.newBuilder().setValue(value).build()
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:166: cannot find symbol
      [javac] symbol : variable Resource
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] return Resource.newBuilder().setName(name).setScalar(
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:172: cannot find symbol
      [javac] symbol : class Resource
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] for (Resource r : resources) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:199: cannot find symbol
      [javac] symbol : class Offer
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] Offer offer = offers.get;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:214: cannot find symbol
      [javac] symbol : class TaskDescription
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] List<List<TaskDescription>> replies =
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:215: cannot find symbol
      [javac] symbol : class TaskDescription
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] new ArrayList<List<TaskDescription>>(numOffers);
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:218: cannot find symbol
      [javac] symbol : class TaskDescription
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] replies.add(new ArrayList<TaskDescription>());
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:223: cannot find symbol
      [javac] symbol : class Offer
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] Offer offer = offers.get;
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:224: cannot find symbol
      [javac] symbol : class TaskDescription
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] TaskDescription task = findTask(
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:237: cannot find symbol
      [javac] symbol : class OfferID
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] OfferID offerId = offers.get.getId();
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:238: cannot find symbol
      [javac] symbol : class Status
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] Status status = d.launchTasks(offerId, replies.get);
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:239: cannot find symbol
      [javac] symbol : variable Status
      [javac] location: class org.apache.hadoop.mapred.FrameworkScheduler
      [javac] if (status != Status.OK) {
      [javac] ^
      [javac] /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java:188: method does not override or implement a method from a supertype
      [javac] @Override
      [javac] ^
      [javac] Note: Some input files use or override a deprecated API.
      [javac] Note: Recompile with -Xlint:deprecation for details.
      [javac] 100 errors

      BUILD FAILED
      /Users/thomas/mesos2/frameworks/hadoop-0.20.2/build.xml:497: The following error occurred while executing this line:
      /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/build.xml:30: The following error occurred while executing this line:
      /Users/thomas/mesos2/frameworks/hadoop-0.20.2/src/contrib/build-contrib.xml:141: Compile failed; see the compiler error output for details.

      It looks like the problem is just that some of the files got moved around in the autotools update, so it should be easy to fix.

        Activity

        Hide
        Thomas Marshall added a comment -

        The error shown in the description is the result of mesos.jar being moved into the src directory, so the solution is to modify /frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml to change the location of mesos.jar.

        After that, there seems to be a problem with some protobufs being renamed, which is fixed by changing lines 167 and 168 in /frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java b replacing Resource.Scalar with Value.Scalar and Resource.Type to Value.Type.

        With those changes, Hadoop will compile, and I can get a namenode and datanode running, but the job tracker returns the error that it can't find class Scheduler, and I'm not sure how to fix this problem.

        Show
        Thomas Marshall added a comment - The error shown in the description is the result of mesos.jar being moved into the src directory, so the solution is to modify /frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml to change the location of mesos.jar. After that, there seems to be a problem with some protobufs being renamed, which is fixed by changing lines 167 and 168 in /frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java b replacing Resource.Scalar with Value.Scalar and Resource.Type to Value.Type. With those changes, Hadoop will compile, and I can get a namenode and datanode running, but the job tracker returns the error that it can't find class Scheduler, and I'm not sure how to fix this problem.
        Hide
        Charles Reiss added a comment -

        I think this is a CLASSPATH issue; bin/hadoop probably needs to be modified where it currently uses MESOS_HOME to look in different locations – both in the case where mesos is installed as through 'make install' and in the case where you want to use a compiled, uninstalled build.

        You can probably work around this by adding libmesos.so to the java library path and a mesos.jar to the classpath manually.

        Show
        Charles Reiss added a comment - I think this is a CLASSPATH issue; bin/hadoop probably needs to be modified where it currently uses MESOS_HOME to look in different locations – both in the case where mesos is installed as through 'make install' and in the case where you want to use a compiled, uninstalled build. You can probably work around this by adding libmesos.so to the java library path and a mesos.jar to the classpath manually.
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/3963/
        -----------------------------------------------------------

        Review request for Benjamin Hindman and Charles Reiss.

        Summary
        -------

        After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail.

        This addresses bug MESOS-148.
        https://issues.apache.org/jira/browse/MESOS-148

        Diffs


        frameworks/hadoop-0.20.2/bin/hadoop 51ba90f
        frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139
        frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc

        Diff: https://reviews.apache.org/r/3963/diff

        Testing
        -------

        Thanks,

        Thomas

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3963/ ----------------------------------------------------------- Review request for Benjamin Hindman and Charles Reiss. Summary ------- After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail. This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs frameworks/hadoop-0.20.2/bin/hadoop 51ba90f frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139 frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc Diff: https://reviews.apache.org/r/3963/diff Testing ------- Thanks, Thomas
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/3963/
        -----------------------------------------------------------

        (Updated 2012-02-20 05:47:25.700632)

        Review request for mesos, Benjamin Hindman and Charles Reiss.

        Summary
        -------

        After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail.

        This addresses bug MESOS-148.
        https://issues.apache.org/jira/browse/MESOS-148

        Diffs


        frameworks/hadoop-0.20.2/bin/hadoop 51ba90f
        frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139
        frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc

        Diff: https://reviews.apache.org/r/3963/diff

        Testing
        -------

        Thanks,

        Thomas

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3963/ ----------------------------------------------------------- (Updated 2012-02-20 05:47:25.700632) Review request for mesos, Benjamin Hindman and Charles Reiss. Summary ------- After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail. This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs frameworks/hadoop-0.20.2/bin/hadoop 51ba90f frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139 frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc Diff: https://reviews.apache.org/r/3963/diff Testing ------- Thanks, Thomas
        Hide
        bob makowski added a comment -

        i am totally new to this source code, but i dont see this mesos.jar anywhere. of course, it could be built on the fly...

        Show
        bob makowski added a comment - i am totally new to this source code, but i dont see this mesos.jar anywhere. of course, it could be built on the fly...
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/3963/#review5219
        -----------------------------------------------------------

        This patch will make things work assuming MESOS_HOME points to a built build directory. Since it only works for the uninstalled case. It would be ideal for us to handle the installed case, too. (You can examine the hierarchy created by make DESTDIR=...) I think we should also be aiming to migrate away from MESOS_HOME as the name of the env. var. to locate mesos binaries – at least uninstalled ones because of source/build dir confusion. But that doesn't need to be done now. (Related bug: MESOS-85.)

        Looks okay to me, otherwise.

        • Charles

        On 2012-02-20 05:47:25, Thomas Marshall wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/3963/

        -----------------------------------------------------------

        (Updated 2012-02-20 05:47:25)

        Review request for mesos, Benjamin Hindman and Charles Reiss.

        Summary

        -------

        After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail.

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        frameworks/hadoop-0.20.2/bin/hadoop 51ba90f

        frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139

        frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc

        Diff: https://reviews.apache.org/r/3963/diff

        Testing

        -------

        Thanks,

        Thomas

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3963/#review5219 ----------------------------------------------------------- This patch will make things work assuming MESOS_HOME points to a built build directory. Since it only works for the uninstalled case. It would be ideal for us to handle the installed case, too. (You can examine the hierarchy created by make DESTDIR=...) I think we should also be aiming to migrate away from MESOS_HOME as the name of the env. var. to locate mesos binaries – at least uninstalled ones because of source/build dir confusion. But that doesn't need to be done now. (Related bug: MESOS-85 .) Looks okay to me, otherwise. Charles On 2012-02-20 05:47:25, Thomas Marshall wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3963/ ----------------------------------------------------------- (Updated 2012-02-20 05:47:25) Review request for mesos, Benjamin Hindman and Charles Reiss. Summary ------- After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail. This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- frameworks/hadoop-0.20.2/bin/hadoop 51ba90f frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139 frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc Diff: https://reviews.apache.org/r/3963/diff Testing ------- Thanks, Thomas
        Hide
        jiraposter@reviews.apache.org added a comment -

        On 2012-02-20 06:00:49, Charles Reiss wrote:

        > This patch will make things work assuming MESOS_HOME points to a built build directory. Since it only works for the uninstalled case. It would be ideal for us to handle the installed case, too. (You can examine the hierarchy created by make DESTDIR=...) I think we should also be aiming to migrate away from MESOS_HOME as the name of the env. var. to locate mesos binaries – at least uninstalled ones because of source/build dir confusion. But that doesn't need to be done now. (Related bug: MESOS-85.)

        >

        > Looks okay to me, otherwise.

        >

        I'm discarding this as this work has moved to https://reviews.apache.org/r/4100.

        • Benjamin

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/3963/#review5219
        -----------------------------------------------------------

        On 2012-02-20 05:47:25, Thomas Marshall wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/3963/

        -----------------------------------------------------------

        (Updated 2012-02-20 05:47:25)

        Review request for mesos, Benjamin Hindman and Charles Reiss.

        Summary

        -------

        After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail.

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        frameworks/hadoop-0.20.2/bin/hadoop 51ba90f

        frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139

        frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc

        Diff: https://reviews.apache.org/r/3963/diff

        Testing

        -------

        Thanks,

        Thomas

        Show
        jiraposter@reviews.apache.org added a comment - On 2012-02-20 06:00:49, Charles Reiss wrote: > This patch will make things work assuming MESOS_HOME points to a built build directory. Since it only works for the uninstalled case. It would be ideal for us to handle the installed case, too. (You can examine the hierarchy created by make DESTDIR=...) I think we should also be aiming to migrate away from MESOS_HOME as the name of the env. var. to locate mesos binaries – at least uninstalled ones because of source/build dir confusion. But that doesn't need to be done now. (Related bug: MESOS-85 .) > > Looks okay to me, otherwise. > I'm discarding this as this work has moved to https://reviews.apache.org/r/4100 . Benjamin ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3963/#review5219 ----------------------------------------------------------- On 2012-02-20 05:47:25, Thomas Marshall wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/3963/ ----------------------------------------------------------- (Updated 2012-02-20 05:47:25) Review request for mesos, Benjamin Hindman and Charles Reiss. Summary ------- After the autotools update, some of the library files that Hadoop depended on were moved, causing compilation to fail. This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- frameworks/hadoop-0.20.2/bin/hadoop 51ba90f frameworks/hadoop-0.20.2/src/contrib/mesos/build.xml 6b53139 frameworks/hadoop-0.20.2/src/contrib/mesos/src/java/org/apache/hadoop/mapred/FrameworkScheduler.java 43416cc Diff: https://reviews.apache.org/r/3963/diff Testing ------- Thanks, Thomas
        Hide
        Benjamin Hindman added a comment -

        From https://reviews.apache.org/r/4100:
        --------------------------------
        Nice work with the tutorial; it really streamlines Hadoop integration with Mesos. Just a couple issues to note. Last week I set up Mesos/Hadoop twice, once on Fedora 16 and the second time on Scientific Linux 6.2.

        The issues are the same for both systems. First, lines 71-80 in TUTORIAL.sh are incorrect for these distributions of Linux. Setting JAVA_HOME breaks installation when the script tries to find javac since, for reasons I have not tracked down, no matter what JAVA_HOME is set to at the beginning of the script, when it gets to the point where it needs javac, JAVA_HOME has changed to a completely wrong directory. Once I commented out these lines and made sure to unset JAVA_HOME, the script ran successfully to completion. (NOTE: I do have to set JAVA_HOME in hadoop-env.sh after installing, but setting it as an environment variable or within the TUTORIAL script will not work.)

        Second, the hadoop-env.sh patch uses the wrong library for Linux systems. Line 20 specifies the Mac OS X library, "libmesos.dylib," but the correct library is "libmesos.so." Perhaps multiple patches are needed, depending on the system.
        --------------------------------

        Show
        Benjamin Hindman added a comment - From https://reviews.apache.org/r/4100: -------------------------------- Nice work with the tutorial; it really streamlines Hadoop integration with Mesos. Just a couple issues to note. Last week I set up Mesos/Hadoop twice, once on Fedora 16 and the second time on Scientific Linux 6.2. The issues are the same for both systems. First, lines 71-80 in TUTORIAL.sh are incorrect for these distributions of Linux. Setting JAVA_HOME breaks installation when the script tries to find javac since, for reasons I have not tracked down, no matter what JAVA_HOME is set to at the beginning of the script, when it gets to the point where it needs javac, JAVA_HOME has changed to a completely wrong directory. Once I commented out these lines and made sure to unset JAVA_HOME, the script ran successfully to completion. (NOTE: I do have to set JAVA_HOME in hadoop-env.sh after installing, but setting it as an environment variable or within the TUTORIAL script will not work.) Second, the hadoop-env.sh patch uses the wrong library for Linux systems. Line 20 specifies the Mac OS X library, "libmesos.dylib," but the correct library is "libmesos.so." Perhaps multiple patches are needed, depending on the system. --------------------------------
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/
        -----------------------------------------------------------

        Review request for mesos, Charles Reiss and Jessica.

        Summary
        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.
        https://issues.apache.org/jira/browse/MESOS-148

        Diffs


        hadoop/TUTORIAL.sh 16d87f0
        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing
        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- Review request for mesos, Charles Reiss and Jessica. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/#review5872
        -----------------------------------------------------------

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch
        <https://reviews.apache.org/r/4299/#comment12808>

        Did you test this on Linux? I think this glob will have several matches, the first of which will be libmesos.la, which I suspect will fail.

        • Charles

        On 2012-03-12 21:50:54, Benjamin Hindman wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/4299/

        -----------------------------------------------------------

        (Updated 2012-03-12 21:50:54)

        Review request for mesos, Charles Reiss and Jessica.

        Summary

        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        hadoop/TUTORIAL.sh 16d87f0

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing

        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/#review5872 ----------------------------------------------------------- hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch < https://reviews.apache.org/r/4299/#comment12808 > Did you test this on Linux? I think this glob will have several matches, the first of which will be libmesos.la, which I suspect will fail. Charles On 2012-03-12 21:50:54, Benjamin Hindman wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- (Updated 2012-03-12 21:50:54) Review request for mesos, Charles Reiss and Jessica. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/#review5930
        -----------------------------------------------------------

        Benjamin, IIRC, if the user does not specify to disable java when s/he runs configure, configure checks for java/javac and exits if not found. And as far as I can tell, you can't run make until you've run configure. Is that a correct assumption?

        So in the normal case, I would think it shouldn't be necessary to check for java before running make hadoop. However, we're working with humans, and humans are generally known to be error prone. I suppose a user could, for some strange reason, disable java when running configure (although I can't see how that would make sense if they were planning to make Hadoop...) or do something else bizarre like copying the files over to another machine after running configure but before running make, so perhaps a check for javac would be in order. As much as I hate copy-paste coding, perhaps you could copy over the check from configure... Or abstract it into some external function? I'm not familiar enough with shell scripting to know the proper procedure.

        • Jessica

        On 2012-03-12 21:50:54, Benjamin Hindman wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/4299/

        -----------------------------------------------------------

        (Updated 2012-03-12 21:50:54)

        Review request for mesos, Charles Reiss and Jessica.

        Summary

        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        hadoop/TUTORIAL.sh 16d87f0

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing

        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/#review5930 ----------------------------------------------------------- Benjamin, IIRC, if the user does not specify to disable java when s/he runs configure, configure checks for java/javac and exits if not found. And as far as I can tell, you can't run make until you've run configure. Is that a correct assumption? So in the normal case, I would think it shouldn't be necessary to check for java before running make hadoop. However, we're working with humans, and humans are generally known to be error prone. I suppose a user could, for some strange reason, disable java when running configure (although I can't see how that would make sense if they were planning to make Hadoop...) or do something else bizarre like copying the files over to another machine after running configure but before running make, so perhaps a check for javac would be in order. As much as I hate copy-paste coding, perhaps you could copy over the check from configure... Or abstract it into some external function? I'm not familiar enough with shell scripting to know the proper procedure. Jessica On 2012-03-12 21:50:54, Benjamin Hindman wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- (Updated 2012-03-12 21:50:54) Review request for mesos, Charles Reiss and Jessica. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        jiraposter@reviews.apache.org added a comment -

        On 2012-03-14 13:03:28, Jessica wrote:

        > Benjamin, IIRC, if the user does not specify to disable java when s/he runs configure, configure checks for java/javac and exits if not found. And as far as I can tell, you can't run make until you've run configure. Is that a correct assumption?

        >

        > So in the normal case, I would think it shouldn't be necessary to check for java before running make hadoop. However, we're working with humans, and humans are generally known to be error prone. I suppose a user could, for some strange reason, disable java when running configure (although I can't see how that would make sense if they were planning to make Hadoop...) or do something else bizarre like copying the files over to another machine after running configure but before running make, so perhaps a check for javac would be in order. As much as I hate copy-paste coding, perhaps you could copy over the check from configure... Or abstract it into some external function? I'm not familiar enough with shell scripting to know the proper procedure.

        Related--the hadoop-env.sh patch does not modify the value of JAVA_HOME, but Hadoop requires this value in order to run. I'm not sure if it would be best to give the user a message saying hadoop-env.sh will need to be manually modified or if the script should try to determine the correct value even if JAVA_HOME is not set before running.

        • Jessica

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/#review5930
        -----------------------------------------------------------

        On 2012-03-12 21:50:54, Benjamin Hindman wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/4299/

        -----------------------------------------------------------

        (Updated 2012-03-12 21:50:54)

        Review request for mesos, Charles Reiss and Jessica.

        Summary

        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        hadoop/TUTORIAL.sh 16d87f0

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing

        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - On 2012-03-14 13:03:28, Jessica wrote: > Benjamin, IIRC, if the user does not specify to disable java when s/he runs configure, configure checks for java/javac and exits if not found. And as far as I can tell, you can't run make until you've run configure. Is that a correct assumption? > > So in the normal case, I would think it shouldn't be necessary to check for java before running make hadoop. However, we're working with humans, and humans are generally known to be error prone. I suppose a user could, for some strange reason, disable java when running configure (although I can't see how that would make sense if they were planning to make Hadoop...) or do something else bizarre like copying the files over to another machine after running configure but before running make, so perhaps a check for javac would be in order. As much as I hate copy-paste coding, perhaps you could copy over the check from configure... Or abstract it into some external function? I'm not familiar enough with shell scripting to know the proper procedure. Related--the hadoop-env.sh patch does not modify the value of JAVA_HOME, but Hadoop requires this value in order to run. I'm not sure if it would be best to give the user a message saying hadoop-env.sh will need to be manually modified or if the script should try to determine the correct value even if JAVA_HOME is not set before running. Jessica ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/#review5930 ----------------------------------------------------------- On 2012-03-12 21:50:54, Benjamin Hindman wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- (Updated 2012-03-12 21:50:54) Review request for mesos, Charles Reiss and Jessica. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        jiraposter@reviews.apache.org added a comment -

        On 2012-03-13 05:51:35, Charles Reiss wrote:

        > hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch, line 21

        > <https://reviews.apache.org/r/4299/diff/1/?file=91278#file91278line21>

        >

        > Did you test this on Linux? I think this glob will have several matches, the first of which will be libmesos.la, which I suspect will fail.

        Yeah, that's still broken. Fixed.

        • Benjamin

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/#review5872
        -----------------------------------------------------------

        On 2012-03-12 21:50:54, Benjamin Hindman wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/4299/

        -----------------------------------------------------------

        (Updated 2012-03-12 21:50:54)

        Review request for mesos, Charles Reiss and Jessica.

        Summary

        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        hadoop/TUTORIAL.sh 16d87f0

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing

        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - On 2012-03-13 05:51:35, Charles Reiss wrote: > hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch, line 21 > < https://reviews.apache.org/r/4299/diff/1/?file=91278#file91278line21 > > > Did you test this on Linux? I think this glob will have several matches, the first of which will be libmesos.la, which I suspect will fail. Yeah, that's still broken. Fixed. Benjamin ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/#review5872 ----------------------------------------------------------- On 2012-03-12 21:50:54, Benjamin Hindman wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- (Updated 2012-03-12 21:50:54) Review request for mesos, Charles Reiss and Jessica. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/
        -----------------------------------------------------------

        (Updated 2012-03-27 05:17:53.365552)

        Review request for mesos, Charles Reiss and Jessica.

        Changes
        -------

        Updates to get it to work on both Linux and Mac OS X.

        Summary
        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.
        https://issues.apache.org/jira/browse/MESOS-148

        Diffs (updated)


        hadoop/TUTORIAL 38d2c17
        hadoop/TUTORIAL.sh 16d87f0
        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing
        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- (Updated 2012-03-27 05:17:53.365552) Review request for mesos, Charles Reiss and Jessica. Changes ------- Updates to get it to work on both Linux and Mac OS X. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs (updated) hadoop/TUTORIAL 38d2c17 hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        jiraposter@reviews.apache.org added a comment -

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/#review6408
        -----------------------------------------------------------

        Ship it!

        LGTM.

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch
        <https://reviews.apache.org/r/4299/#comment14010>

        Okay, but I'd prefer multiple lines for this.

        • Charles

        On 2012-03-27 05:17:53, Benjamin Hindman wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/4299/

        -----------------------------------------------------------

        (Updated 2012-03-27 05:17:53)

        Review request for mesos, Charles Reiss and Jessica.

        Summary

        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        hadoop/TUTORIAL 38d2c17

        hadoop/TUTORIAL.sh 16d87f0

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing

        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/#review6408 ----------------------------------------------------------- Ship it! LGTM. hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch < https://reviews.apache.org/r/4299/#comment14010 > Okay, but I'd prefer multiple lines for this. Charles On 2012-03-27 05:17:53, Benjamin Hindman wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- (Updated 2012-03-27 05:17:53) Review request for mesos, Charles Reiss and Jessica. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- hadoop/TUTORIAL 38d2c17 hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        jiraposter@reviews.apache.org added a comment -

        On 2012-03-27 06:20:30, Charles Reiss wrote:

        > hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch, line 21

        > <https://reviews.apache.org/r/4299/diff/1-2/?file=91278#file91278line21>

        >

        > Okay, but I'd prefer multiple lines for this.

        Of course, I factored it out. Not sure why I didn't do that in the first place. :/ Thanks.

        • Benjamin

        -----------------------------------------------------------
        This is an automatically generated e-mail. To reply, visit:
        https://reviews.apache.org/r/4299/#review6408
        -----------------------------------------------------------

        On 2012-03-27 05:17:53, Benjamin Hindman wrote:

        -----------------------------------------------------------

        This is an automatically generated e-mail. To reply, visit:

        https://reviews.apache.org/r/4299/

        -----------------------------------------------------------

        (Updated 2012-03-27 05:17:53)

        Review request for mesos, Charles Reiss and Jessica.

        Summary

        -------

        See summary.

        Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions?

        This addresses bug MESOS-148.

        https://issues.apache.org/jira/browse/MESOS-148

        Diffs

        -----

        hadoop/TUTORIAL 38d2c17

        hadoop/TUTORIAL.sh 16d87f0

        hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6

        Diff: https://reviews.apache.org/r/4299/diff

        Testing

        -------

        make && make hadoop

        Thanks,

        Benjamin

        Show
        jiraposter@reviews.apache.org added a comment - On 2012-03-27 06:20:30, Charles Reiss wrote: > hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch, line 21 > < https://reviews.apache.org/r/4299/diff/1-2/?file=91278#file91278line21 > > > Okay, but I'd prefer multiple lines for this. Of course, I factored it out. Not sure why I didn't do that in the first place. :/ Thanks. Benjamin ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/#review6408 ----------------------------------------------------------- On 2012-03-27 05:17:53, Benjamin Hindman wrote: ----------------------------------------------------------- This is an automatically generated e-mail. To reply, visit: https://reviews.apache.org/r/4299/ ----------------------------------------------------------- (Updated 2012-03-27 05:17:53) Review request for mesos, Charles Reiss and Jessica. Summary ------- See summary. Note to Jessica: I made JAVA_HOME be optional, but it doesn't sound like this would be sufficient in your environment. Do you think adding a check for 'javac' under JAVA_HOME would help? Any other suggestions? This addresses bug MESOS-148 . https://issues.apache.org/jira/browse/MESOS-148 Diffs ----- hadoop/TUTORIAL 38d2c17 hadoop/TUTORIAL.sh 16d87f0 hadoop/hadoop-0.20.205.0_conf_hadoop-env.sh.patch 35c16a6 Diff: https://reviews.apache.org/r/4299/diff Testing ------- make && make hadoop Thanks, Benjamin
        Hide
        Jessica J added a comment -

        The version of the included Hadoop (v. 0.20.*) contains a major bug that was fixed in subsequent versions. This bug prevents HDFS nodes from starting properly on low-activity machines. The patch is extremely simple (even to apply by hand) that doesn't break any of your other code, so I would suggest applying the patch in your included version. (You could even ship it patched rather than patching it during Hadoop setup.) Patch is here: https://issues.apache.org/jira/browse/HDFS-1835.

        Show
        Jessica J added a comment - The version of the included Hadoop (v. 0.20.*) contains a major bug that was fixed in subsequent versions. This bug prevents HDFS nodes from starting properly on low-activity machines. The patch is extremely simple (even to apply by hand) that doesn't break any of your other code, so I would suggest applying the patch in your included version. (You could even ship it patched rather than patching it during Hadoop setup.) Patch is here: https://issues.apache.org/jira/browse/HDFS-1835 .

          People

          • Assignee:
            Benjamin Hindman
            Reporter:
            Thomas Marshall
          • Votes:
            1 Vote for this issue
            Watchers:
            2 Start watching this issue

            Dates

            • Due:
              Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 24h
              24h
              Remaining:
              Remaining Estimate - 24h
              24h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development