Details
-
Bug
-
Status: Open
-
Major
-
Resolution: Unresolved
-
None
-
None
-
None
-
None
Description
I tried to work through the pig tutorial and point 3) in the local mode doesn't work for me.
Here is my stack trace:
2016-04-04 16:11:32,244 [Thread-12] INFO org.apache.hadoop.metrics.jvm.JvmMetrics - Cannot initialize JVM Metrics with processName=JobTracker, sessionId= -
2016-04-04 16:11:32,250 [Thread-12] INFO org.apache.hadoop.mapred.MapTask - io.sort.mb = 100
2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask - data buffer = 79691776/99614720
2016-04-04 16:11:32,274 [Thread-12] INFO org.apache.hadoop.mapred.MapTask - record buffer = 262144/327680
2016-04-04 16:11:32,374 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - HadoopJobId: job_local_0001
2016-04-04 16:11:32,376 [main] INFO org.apache.pig.backend.hadoop.executionengine.mapReduceLayer.MapReduceLauncher - 0% complete
2016-04-04 16:11:32,508 [Thread-12] INFO org.apache.hadoop.mapred.MapTask - Starting flush of map output
2016-04-04 16:11:32,554 [Thread-12] WARN org.apache.hadoop.mapred.LocalJobRunner - job_local_0001
java.io.IOException: Expecting a line not the end of stream
at org.apache.hadoop.fs.DF.parseExecResult(DF.java:109)
at org.apache.hadoop.util.Shell.runCommand(Shell.java:179)
at org.apache.hadoop.util.Shell.run(Shell.java:134)
at org.apache.hadoop.fs.DF.getAvailable(DF.java:73)
at org.apache.hadoop.fs.LocalDirAllocator$AllocatorPerContext.getLocalPathForWrite(LocalDirAllocator.java:329)
at org.apache.hadoop.fs.LocalDirAllocator.getLocalPathForWrite(LocalDirAllocator.java:124)
at org.apache.hadoop.mapred.MapOutputFile.getSpillFileForWrite(MapOutputFile.java:107)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.sortAndSpill(MapTask.java:1221)
at org.apache.hadoop.mapred.MapTask$MapOutputBuffer.flush(MapTask.java:1129)
at org.apache.hadoop.mapred.MapTask$NewOutputCollector.close(MapTask.java:549)
at org.apache.hadoop.mapred.MapTask.runNewMapper(MapTask.java:623)
at org.apache.hadoop.mapred.MapTask.run(MapTask.java:305)
at org.apache.hadoop.mapred.LocalJobRunner$Job.run(LocalJobRunner.java:177)
If necessary I could capture all stdout and stderr and attach it.