Running in mode: translation [SCHED] planned job for class edu.jhu.thrax.hadoop.jobs.VocabularyJob [SCHED] planned job for class edu.jhu.thrax.hadoop.jobs.ExtractionJob [SCHED] planned job for class edu.jhu.thrax.hadoop.features.mapred.TargetPhraseGivenSourceFeature [SCHED] planned job for class edu.jhu.thrax.hadoop.features.mapred.SourcePhraseGivenTargetFeature [SCHED] planned job for class edu.jhu.thrax.hadoop.jobs.TargetWordGivenSourceWordProbabilityJob [SCHED] planned job for class edu.jhu.thrax.hadoop.jobs.SourceWordGivenTargetWordProbabilityJob [SCHED] planned job for class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob [SCHED] planned job for class edu.jhu.thrax.hadoop.jobs.OutputJob [SCHED] class edu.jhu.thrax.hadoop.jobs.OutputJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.features.mapred.SourcePhraseGivenTargetFeature in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.ExtractionJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state READY [SCHED] class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.TargetWordGivenSourceWordProbabilityJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state READY [SCHED] class edu.jhu.thrax.hadoop.jobs.SourceWordGivenTargetWordProbabilityJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state READY [SCHED] class edu.jhu.thrax.hadoop.jobs.ExtractionJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state READY [SCHED] class edu.jhu.thrax.hadoop.features.mapred.TargetPhraseGivenSourceFeature in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.ExtractionJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state WAITING [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state READY [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state RUNNING 16/08/17 21:13:58 INFO jvm.JvmMetrics: Initializing JVM Metrics with processName=JobTracker, sessionId= 16/08/17 21:13:58 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:13:59 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:13:59 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:13:59 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:13:59 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:13:59 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:13:59 INFO mapred.MapTask: bufstart = 0; bufend = 1163491; bufvoid = 99614720 16/08/17 21:13:59 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:13:59 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:00 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:00 INFO mapred.MapTask: bufstart = 1163491; bufend = 2339813; bufvoid = 99614720 16/08/17 21:14:00 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:14:00 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:00 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:00 INFO mapred.MapTask: Finished spill 2 16/08/17 21:14:00 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:14:00 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 283315 bytes 16/08/17 21:14:00 INFO mapred.TaskRunner: Task:attempt_local_0001_m_000000_0 is done. And is in the process of commiting 16/08/17 21:14:00 INFO mapred.LocalJobRunner: 16/08/17 21:14:00 INFO mapred.TaskRunner: Task 'attempt_local_0001_m_000000_0' done. 16/08/17 21:14:00 INFO mapred.LocalJobRunner: 16/08/17 21:14:00 INFO mapred.Merger: Merging 1 sorted segments 16/08/17 21:14:00 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 180125 bytes 16/08/17 21:14:00 INFO mapred.LocalJobRunner: 16/08/17 21:14:00 INFO mapred.TaskRunner: Task:attempt_local_0001_r_000000_0 is done. And is in the process of commiting 16/08/17 21:14:00 INFO mapred.LocalJobRunner: 16/08/17 21:14:00 INFO mapred.TaskRunner: Task attempt_local_0001_r_000000_0 is allowed to commit now 16/08/17 21:14:00 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0001_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/vocabulary 16/08/17 21:14:00 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:00 INFO mapred.TaskRunner: Task 'attempt_local_0001_r_000000_0' done. [SCHED] class edu.jhu.thrax.hadoop.jobs.VocabularyJob in state SUCCESS [SCHED] class edu.jhu.thrax.hadoop.jobs.TargetWordGivenSourceWordProbabilityJob in state READY [SCHED] class edu.jhu.thrax.hadoop.jobs.SourceWordGivenTargetWordProbabilityJob in state READY [SCHED] class edu.jhu.thrax.hadoop.jobs.ExtractionJob in state READY [SCHED] class edu.jhu.thrax.hadoop.jobs.TargetWordGivenSourceWordProbabilityJob in state RUNNING [SCHED] class edu.jhu.thrax.hadoop.jobs.SourceWordGivenTargetWordProbabilityJob in state RUNNING 16/08/17 21:14:04 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized [SCHED] class edu.jhu.thrax.hadoop.jobs.ExtractionJob in state RUNNING 16/08/17 21:14:04 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 16/08/17 21:14:04 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 16/08/17 21:14:04 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:04 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:04 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:04 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:04 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:04 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:04 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:04 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:04 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:04 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:04 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:04 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:04 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:04 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:04 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:06 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:06 INFO mapred.MapTask: bufstart = 0; bufend = 3145728; bufvoid = 99614720 16/08/17 21:14:06 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:14:06 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:06 INFO mapred.MapTask: bufstart = 0; bufend = 3145728; bufvoid = 99614720 16/08/17 21:14:06 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:14:08 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:08 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:09 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:09 INFO mapred.MapTask: bufstart = 3145728; bufend = 6291444; bufvoid = 99614720 16/08/17 21:14:09 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:14:09 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:09 INFO mapred.MapTask: bufstart = 0; bufend = 10052624; bufvoid = 99614720 16/08/17 21:14:09 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:14:09 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:09 INFO mapred.MapTask: bufstart = 3145728; bufend = 6291444; bufvoid = 99614720 16/08/17 21:14:09 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:14:10 INFO mapred.LocalJobRunner: 16/08/17 21:14:10 INFO mapred.LocalJobRunner: 16/08/17 21:14:10 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:10 INFO mapred.LocalJobRunner: 16/08/17 21:14:10 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:11 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:11 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:11 INFO mapred.MapTask: Finished spill 2 16/08/17 21:14:11 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:14:11 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 2091158 bytes 16/08/17 21:14:11 INFO mapred.MapTask: Finished spill 2 16/08/17 21:14:11 INFO mapred.TaskRunner: Task:attempt_local_0002_m_000000_0 is done. And is in the process of commiting 16/08/17 21:14:11 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:14:11 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 2071250 bytes 16/08/17 21:14:11 INFO mapred.LocalJobRunner: 16/08/17 21:14:11 INFO mapred.TaskRunner: Task 'attempt_local_0002_m_000000_0' done. 16/08/17 21:14:11 INFO mapred.LocalJobRunner: 16/08/17 21:14:11 INFO mapred.Merger: Merging 1 sorted segments 16/08/17 21:14:11 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 1697390 bytes 16/08/17 21:14:11 INFO mapred.LocalJobRunner: 16/08/17 21:14:11 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:11 INFO mapred.TaskRunner: Task:attempt_local_0003_m_000000_0 is done. And is in the process of commiting 16/08/17 21:14:11 INFO mapred.LocalJobRunner: 16/08/17 21:14:11 INFO mapred.TaskRunner: Task 'attempt_local_0003_m_000000_0' done. 16/08/17 21:14:11 INFO mapred.LocalJobRunner: 16/08/17 21:14:11 INFO mapred.Merger: Merging 1 sorted segments 16/08/17 21:14:11 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 1678882 bytes 16/08/17 21:14:11 INFO mapred.LocalJobRunner: 16/08/17 21:14:11 INFO mapred.TaskRunner: Task:attempt_local_0002_r_000000_0 is done. And is in the process of commiting 16/08/17 21:14:11 INFO mapred.LocalJobRunner: 16/08/17 21:14:11 INFO mapred.TaskRunner: Task attempt_local_0002_r_000000_0 is allowed to commit now 16/08/17 21:14:11 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0002_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/lexprobs_tgs 16/08/17 21:14:11 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:11 INFO mapred.TaskRunner: Task 'attempt_local_0002_r_000000_0' done. 16/08/17 21:14:12 INFO mapred.TaskRunner: Task:attempt_local_0003_r_000000_0 is done. And is in the process of commiting 16/08/17 21:14:12 INFO mapred.LocalJobRunner: 16/08/17 21:14:12 INFO mapred.TaskRunner: Task attempt_local_0003_r_000000_0 is allowed to commit now 16/08/17 21:14:12 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0003_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/lexprobs_sgt 16/08/17 21:14:12 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:12 INFO mapred.TaskRunner: Task 'attempt_local_0003_r_000000_0' done. 16/08/17 21:14:12 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:12 INFO mapred.MapTask: bufstart = 10052624; bufend = 20059364; bufvoid = 99614720 16/08/17 21:14:12 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:14:13 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:13 INFO mapred.LocalJobRunner: [SCHED] class edu.jhu.thrax.hadoop.jobs.SourceWordGivenTargetWordProbabilityJob in state SUCCESS [SCHED] class edu.jhu.thrax.hadoop.jobs.TargetWordGivenSourceWordProbabilityJob in state SUCCESS 16/08/17 21:14:14 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:14 INFO mapred.MapTask: bufstart = 20059364; bufend = 30082214; bufvoid = 99614720 16/08/17 21:14:14 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680 16/08/17 21:14:15 INFO mapred.MapTask: Finished spill 2 16/08/17 21:14:16 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:16 INFO mapred.MapTask: bufstart = 30082214; bufend = 40064224; bufvoid = 99614720 16/08/17 21:14:16 INFO mapred.MapTask: kvstart = 131070; kvend = 65533; length = 327680 16/08/17 21:14:16 INFO mapred.LocalJobRunner: 16/08/17 21:14:17 INFO mapred.MapTask: Finished spill 3 16/08/17 21:14:18 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:18 INFO mapred.MapTask: bufstart = 40064224; bufend = 50140824; bufvoid = 99614720 16/08/17 21:14:18 INFO mapred.MapTask: kvstart = 65533; kvend = 327677; length = 327680 16/08/17 21:14:18 INFO mapred.MapTask: Finished spill 4 16/08/17 21:14:19 INFO mapred.LocalJobRunner: 16/08/17 21:14:19 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:19 INFO mapred.MapTask: bufstart = 50140824; bufend = 60173628; bufvoid = 99614720 16/08/17 21:14:19 INFO mapred.MapTask: kvstart = 327677; kvend = 262140; length = 327680 16/08/17 21:14:20 INFO mapred.MapTask: Finished spill 5 16/08/17 21:14:21 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:22 INFO mapred.MapTask: Finished spill 6 16/08/17 21:14:22 INFO mapred.Merger: Merging 7 sorted segments 16/08/17 21:14:22 INFO mapred.Merger: Down to the last merge-pass, with 7 segments left of total size: 37649521 bytes 16/08/17 21:14:22 INFO mapred.LocalJobRunner: 16/08/17 21:14:23 INFO mapred.TaskRunner: Task:attempt_local_0004_m_000000_0 is done. And is in the process of commiting 16/08/17 21:14:23 INFO mapred.LocalJobRunner: 16/08/17 21:14:23 INFO mapred.TaskRunner: Task 'attempt_local_0004_m_000000_0' done. 16/08/17 21:14:23 INFO mapred.LocalJobRunner: 16/08/17 21:14:23 INFO mapred.Merger: Merging 1 sorted segments 16/08/17 21:14:23 INFO mapred.Merger: Down to the last merge-pass, with 1 segments left of total size: 34102283 bytes 16/08/17 21:14:23 INFO mapred.LocalJobRunner: 16/08/17 21:14:24 INFO mapred.TaskRunner: Task:attempt_local_0004_r_000000_0 is done. And is in the process of commiting 16/08/17 21:14:24 INFO mapred.LocalJobRunner: 16/08/17 21:14:24 INFO mapred.TaskRunner: Task attempt_local_0004_r_000000_0 is allowed to commit now 16/08/17 21:14:24 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0004_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/rules 16/08/17 21:14:24 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:24 INFO mapred.TaskRunner: Task 'attempt_local_0004_r_000000_0' done. [SCHED] class edu.jhu.thrax.hadoop.jobs.ExtractionJob in state SUCCESS [SCHED] class edu.jhu.thrax.hadoop.features.mapred.SourcePhraseGivenTargetFeature in state READY [SCHED] class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob in state READY [SCHED] class edu.jhu.thrax.hadoop.features.mapred.TargetPhraseGivenSourceFeature in state READY [SCHED] class edu.jhu.thrax.hadoop.features.mapred.SourcePhraseGivenTargetFeature in state RUNNING [SCHED] class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob in state RUNNING [SCHED] class edu.jhu.thrax.hadoop.features.mapred.TargetPhraseGivenSourceFeature in state RUNNING 16/08/17 21:14:29 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 16/08/17 21:14:29 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 16/08/17 21:14:29 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 16/08/17 21:14:29 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:29 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:29 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:29 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:29 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:29 INFO input.FileInputFormat: Total input paths to process : 1 16/08/17 21:14:29 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:29 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:29 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:29 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:29 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:29 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:29 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:30 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:30 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:31 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:31 INFO mapred.MapTask: bufstart = 0; bufend = 9214452; bufvoid = 99614720 16/08/17 21:14:31 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:14:31 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:31 INFO mapred.MapTask: bufstart = 0; bufend = 8986048; bufvoid = 99614720 16/08/17 21:14:31 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:14:31 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:31 INFO mapred.MapTask: bufstart = 0; bufend = 12063000; bufvoid = 99614720 16/08/17 21:14:31 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:14:32 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:32 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:32 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:33 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:33 INFO mapred.MapTask: bufstart = 9214452; bufend = 18431836; bufvoid = 99614720 16/08/17 21:14:33 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:14:33 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:33 INFO mapred.MapTask: bufstart = 8986048; bufend = 18036100; bufvoid = 99614720 16/08/17 21:14:33 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:14:33 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:33 INFO mapred.MapTask: bufstart = 12063000; bufend = 24446370; bufvoid = 99614720 16/08/17 21:14:33 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:14:34 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:34 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:34 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:34 INFO mapred.MapTask: Finished spill 2 16/08/17 21:14:34 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:14:34 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 29550576 bytes 16/08/17 21:14:35 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:35 INFO mapred.TaskRunner: Task:attempt_local_0005_m_000000_0 is done. And is in the process of commiting 16/08/17 21:14:35 INFO mapred.LocalJobRunner: 16/08/17 21:14:35 INFO mapred.TaskRunner: Task 'attempt_local_0005_m_000000_0' done. 16/08/17 21:14:35 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:35 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:35 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:35 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:35 INFO mapred.MapTask: bufstart = 18431836; bufend = 27451320; bufvoid = 99614720 16/08/17 21:14:35 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680 16/08/17 21:14:35 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:35 INFO mapred.MapTask: bufstart = 18036100; bufend = 26861552; bufvoid = 99614720 16/08/17 21:14:35 INFO mapred.MapTask: kvstart = 196607; kvend = 131070; length = 327680 16/08/17 21:14:35 INFO mapred.LocalJobRunner: 16/08/17 21:14:35 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:35 INFO mapred.LocalJobRunner: 16/08/17 21:14:36 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:36 INFO mapred.TaskRunner: Task:attempt_local_0005_m_000001_0 is done. And is in the process of commiting 16/08/17 21:14:36 INFO mapred.LocalJobRunner: 16/08/17 21:14:36 INFO mapred.TaskRunner: Task 'attempt_local_0005_m_000001_0' done. 16/08/17 21:14:36 INFO mapred.LocalJobRunner: 16/08/17 21:14:36 INFO mapred.Merger: Merging 2 sorted segments 16/08/17 21:14:36 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 34022289 bytes 16/08/17 21:14:36 INFO mapred.LocalJobRunner: [1000] [2000] [3000] [4000] [5000] [6000] [7000] [8000] [9000] [10000] [1000] [2000] [3000] [4000] [5000] [6000] [7000] [8000] 16/08/17 21:14:37 INFO mapred.MapTask: Finished spill 2 16/08/17 21:14:37 INFO mapred.MapTask: Finished spill 2 16/08/17 21:14:38 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:38 INFO mapred.MapTask: bufstart = 26861552; bufend = 36013624; bufvoid = 99614720 16/08/17 21:14:38 INFO mapred.MapTask: kvstart = 131070; kvend = 65533; length = 327680 16/08/17 21:14:38 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:38 INFO mapred.MapTask: bufstart = 27451320; bufend = 36809616; bufvoid = 99614720 16/08/17 21:14:38 INFO mapred.MapTask: kvstart = 131070; kvend = 65533; length = 327680 16/08/17 21:14:38 INFO mapred.LocalJobRunner: 16/08/17 21:14:38 INFO mapred.LocalJobRunner: 16/08/17 21:14:39 INFO mapred.MapTask: Finished spill 3 16/08/17 21:14:39 INFO mapred.MapTask: Finished spill 3 16/08/17 21:14:40 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:40 INFO mapred.MapTask: bufstart = 36013624; bufend = 45204320; bufvoid = 99614720 16/08/17 21:14:40 INFO mapred.MapTask: kvstart = 65533; kvend = 327677; length = 327680 16/08/17 21:14:40 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:40 INFO mapred.MapTask: bufstart = 36809616; bufend = 46223892; bufvoid = 99614720 16/08/17 21:14:40 INFO mapred.MapTask: kvstart = 65533; kvend = 327677; length = 327680 16/08/17 21:14:41 INFO mapred.MapTask: Finished spill 4 16/08/17 21:14:41 INFO mapred.LocalJobRunner: 16/08/17 21:14:41 INFO mapred.LocalJobRunner: 16/08/17 21:14:41 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:41 INFO mapred.MapTask: bufstart = 45204320; bufend = 54349380; bufvoid = 99614720 16/08/17 21:14:41 INFO mapred.MapTask: kvstart = 327677; kvend = 262140; length = 327680 16/08/17 21:14:42 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:42 INFO mapred.MapTask: Finished spill 4 16/08/17 21:14:43 INFO mapred.MapTask: Finished spill 5 16/08/17 21:14:43 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:43 INFO mapred.MapTask: bufstart = 46223892; bufend = 55538432; bufvoid = 99614720 16/08/17 21:14:43 INFO mapred.MapTask: kvstart = 327677; kvend = 262140; length = 327680 16/08/17 21:14:44 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:44 INFO mapred.MapTask: bufstart = 54349380; bufend = 63332008; bufvoid = 99614720 16/08/17 21:14:44 INFO mapred.MapTask: kvstart = 262140; kvend = 196603; length = 327680 16/08/17 21:14:44 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:44 INFO mapred.LocalJobRunner: 16/08/17 21:14:44 INFO mapred.LocalJobRunner: 16/08/17 21:14:45 INFO mapred.MapTask: Finished spill 5 16/08/17 21:14:45 INFO mapred.MapTask: Finished spill 6 16/08/17 21:14:45 INFO mapred.MapTask: Finished spill 7 16/08/17 21:14:45 INFO mapred.Merger: Merging 8 sorted segments 16/08/17 21:14:45 INFO mapred.Merger: Down to the last merge-pass, with 8 segments left of total size: 63636520 bytes 16/08/17 21:14:45 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:45 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:45 INFO mapred.MapTask: bufstart = 55538432; bufend = 64638144; bufvoid = 99614720 16/08/17 21:14:45 INFO mapred.MapTask: kvstart = 262140; kvend = 196603; length = 327680 16/08/17 21:14:45 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:47 INFO mapred.MapTask: Finished spill 6 16/08/17 21:14:47 INFO mapred.MapTask: Finished spill 7 16/08/17 21:14:47 INFO mapred.Merger: Merging 8 sorted segments 16/08/17 21:14:47 INFO mapred.Merger: Down to the last merge-pass, with 8 segments left of total size: 66265836 bytes 16/08/17 21:14:47 INFO mapred.LocalJobRunner: 16/08/17 21:14:47 INFO mapred.LocalJobRunner: 16/08/17 21:14:48 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:50 INFO mapred.LocalJobRunner: 16/08/17 21:14:51 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:50 INFO mapred.LocalJobRunner: 16/08/17 21:14:51 INFO mapred.TaskRunner: Task:attempt_local_0006_m_000000_0 is done. And is in the process of commiting 16/08/17 21:14:51 INFO mapred.LocalJobRunner: 16/08/17 21:14:51 INFO mapred.TaskRunner: Task 'attempt_local_0006_m_000000_0' done. 16/08/17 21:14:51 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:51 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:51 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:51 INFO mapred.TaskRunner: Task:attempt_local_0005_r_000000_0 is done. And is in the process of commiting 16/08/17 21:14:51 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:51 INFO mapred.TaskRunner: Task attempt_local_0005_r_000000_0 is allowed to commit now 16/08/17 21:14:51 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0005_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/annotation 16/08/17 21:14:51 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:51 INFO mapred.TaskRunner: Task 'attempt_local_0005_r_000000_0' done. 16/08/17 21:14:52 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:52 INFO mapred.MapTask: bufstart = 0; bufend = 8874932; bufvoid = 99614720 16/08/17 21:14:52 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:14:52 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:53 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:53 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:53 INFO mapred.Merger: Merging 2 sorted segments 16/08/17 21:14:53 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 9937696 bytes 16/08/17 21:14:53 INFO mapred.TaskRunner: Task:attempt_local_0007_m_000000_0 is done. And is in the process of commiting 16/08/17 21:14:53 INFO mapred.LocalJobRunner: 16/08/17 21:14:53 INFO mapred.TaskRunner: Task 'attempt_local_0007_m_000000_0' done. 16/08/17 21:14:53 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:14:53 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:14:53 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:14:53 INFO mapred.TaskRunner: Task:attempt_local_0006_m_000001_0 is done. And is in the process of commiting 16/08/17 21:14:53 INFO mapred.LocalJobRunner: 16/08/17 21:14:53 INFO mapred.TaskRunner: Task 'attempt_local_0006_m_000001_0' done. 16/08/17 21:14:53 INFO mapred.LocalJobRunner: 16/08/17 21:14:53 INFO mapred.Merger: Merging 2 sorted segments 16/08/17 21:14:53 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 73574178 bytes 16/08/17 21:14:53 INFO mapred.LocalJobRunner: 16/08/17 21:14:54 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:14:54 INFO mapred.MapTask: bufstart = 0; bufend = 8987564; bufvoid = 99614720 16/08/17 21:14:54 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 [SCHED] class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob in state SUCCESS 16/08/17 21:14:55 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:14:56 INFO mapred.MapTask: Finished spill 0 16/08/17 21:14:56 INFO mapred.MapTask: Finished spill 1 16/08/17 21:14:56 INFO mapred.Merger: Merging 2 sorted segments 16/08/17 21:14:56 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 10286612 bytes 16/08/17 21:14:56 INFO mapred.TaskRunner: Task:attempt_local_0007_m_000001_0 is done. And is in the process of commiting 16/08/17 21:14:56 INFO mapred.LocalJobRunner: 16/08/17 21:14:56 INFO mapred.TaskRunner: Task 'attempt_local_0007_m_000001_0' done. 16/08/17 21:14:56 INFO mapred.LocalJobRunner: 16/08/17 21:14:56 INFO mapred.Merger: Merging 2 sorted segments 16/08/17 21:14:56 INFO mapred.Merger: Down to the last merge-pass, with 2 segments left of total size: 75710598 bytes 16/08/17 21:14:56 INFO mapred.LocalJobRunner: 16/08/17 21:14:57 INFO mapred.TaskRunner: Task:attempt_local_0006_r_000000_0 is done. And is in the process of commiting 16/08/17 21:14:57 INFO mapred.LocalJobRunner: 16/08/17 21:14:57 INFO mapred.TaskRunner: Task attempt_local_0006_r_000000_0 is allowed to commit now 16/08/17 21:14:57 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0006_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/e_given_f_phrase 16/08/17 21:14:57 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:14:57 INFO mapred.TaskRunner: Task 'attempt_local_0006_r_000000_0' done. [SCHED] class edu.jhu.thrax.hadoop.features.mapred.TargetPhraseGivenSourceFeature in state SUCCESS 16/08/17 21:15:00 INFO mapred.TaskRunner: Task:attempt_local_0007_r_000000_0 is done. And is in the process of commiting 16/08/17 21:15:00 INFO mapred.LocalJobRunner: 16/08/17 21:15:00 INFO mapred.TaskRunner: Task attempt_local_0007_r_000000_0 is allowed to commit now 16/08/17 21:15:00 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0007_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/f_given_e_phrase 16/08/17 21:15:00 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:00 INFO mapred.TaskRunner: Task 'attempt_local_0007_r_000000_0' done. [SCHED] class edu.jhu.thrax.hadoop.features.mapred.SourcePhraseGivenTargetFeature in state SUCCESS [SCHED] class edu.jhu.thrax.hadoop.jobs.OutputJob in state READY [SCHED] class edu.jhu.thrax.hadoop.jobs.OutputJob in state RUNNING 16/08/17 21:15:04 INFO jvm.JvmMetrics: Cannot initialize JVM Metrics with processName=JobTracker, sessionId= - already initialized 16/08/17 21:15:04 INFO input.FileInputFormat: Total input paths to process : 3 16/08/17 21:15:04 INFO input.FileInputFormat: Total input paths to process : 3 16/08/17 21:15:04 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:15:04 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:15:04 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:15:05 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:05 INFO mapred.MapTask: bufstart = 0; bufend = 10967464; bufvoid = 99614720 16/08/17 21:15:05 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:15:06 INFO mapred.MapTask: Finished spill 0 16/08/17 21:15:07 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:07 INFO mapred.MapTask: bufstart = 10967464; bufend = 22187290; bufvoid = 99614720 16/08/17 21:15:07 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:15:07 INFO mapred.MapTask: Finished spill 1 16/08/17 21:15:08 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:15:08 INFO mapred.MapTask: Finished spill 2 16/08/17 21:15:08 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:15:08 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 31416274 bytes 16/08/17 21:15:08 INFO mapred.TaskRunner: Task:attempt_local_0008_m_000000_0 is done. And is in the process of commiting 16/08/17 21:15:08 INFO mapred.LocalJobRunner: 16/08/17 21:15:08 INFO mapred.TaskRunner: Task 'attempt_local_0008_m_000000_0' done. 16/08/17 21:15:08 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:15:08 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:15:08 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:15:09 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:09 INFO mapred.MapTask: bufstart = 0; bufend = 11146280; bufvoid = 99614720 16/08/17 21:15:09 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:15:10 INFO mapred.MapTask: Finished spill 0 16/08/17 21:15:11 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:11 INFO mapred.MapTask: bufstart = 11146280; bufend = 22215698; bufvoid = 99614720 16/08/17 21:15:11 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:15:12 INFO mapred.MapTask: Finished spill 1 16/08/17 21:15:12 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:15:13 INFO mapred.MapTask: Finished spill 2 16/08/17 21:15:13 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:15:13 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 31416274 bytes 16/08/17 21:15:13 INFO mapred.TaskRunner: Task:attempt_local_0008_m_000001_0 is done. And is in the process of commiting 16/08/17 21:15:13 INFO mapred.LocalJobRunner: 16/08/17 21:15:13 INFO mapred.TaskRunner: Task 'attempt_local_0008_m_000001_0' done. 16/08/17 21:15:13 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:15:13 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:15:13 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:15:14 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:14 INFO mapred.MapTask: bufstart = 0; bufend = 11409070; bufvoid = 99614720 16/08/17 21:15:14 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:15:15 INFO mapred.MapTask: Finished spill 0 16/08/17 21:15:16 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:16 INFO mapred.MapTask: bufstart = 11409070; bufend = 22687913; bufvoid = 99614720 16/08/17 21:15:16 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:15:16 INFO mapred.MapTask: Finished spill 1 16/08/17 21:15:16 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:15:16 INFO mapred.MapTask: Finished spill 2 16/08/17 21:15:16 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:15:16 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 29350158 bytes 16/08/17 21:15:17 INFO mapred.TaskRunner: Task:attempt_local_0008_m_000002_0 is done. And is in the process of commiting 16/08/17 21:15:17 INFO mapred.LocalJobRunner: 16/08/17 21:15:17 INFO mapred.TaskRunner: Task 'attempt_local_0008_m_000002_0' done. 16/08/17 21:15:17 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:15:17 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:15:17 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:15:18 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:18 INFO mapred.MapTask: bufstart = 0; bufend = 11220126; bufvoid = 99614720 16/08/17 21:15:18 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:15:18 INFO mapred.MapTask: Finished spill 0 16/08/17 21:15:19 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:19 INFO mapred.MapTask: bufstart = 11220126; bufend = 22595014; bufvoid = 99614720 16/08/17 21:15:19 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:15:20 INFO mapred.MapTask: Finished spill 1 16/08/17 21:15:20 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:15:20 INFO mapred.MapTask: Finished spill 2 16/08/17 21:15:20 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:15:20 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 29323524 bytes 16/08/17 21:15:21 INFO mapred.TaskRunner: Task:attempt_local_0008_m_000003_0 is done. And is in the process of commiting 16/08/17 21:15:21 INFO mapred.LocalJobRunner: 16/08/17 21:15:21 INFO mapred.TaskRunner: Task 'attempt_local_0008_m_000003_0' done. 16/08/17 21:15:21 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:15:21 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:15:21 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:15:22 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:22 INFO mapred.MapTask: bufstart = 0; bufend = 11580164; bufvoid = 99614720 16/08/17 21:15:22 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:15:22 INFO mapred.MapTask: Finished spill 0 16/08/17 21:15:23 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:23 INFO mapred.MapTask: bufstart = 11580164; bufend = 23238807; bufvoid = 99614720 16/08/17 21:15:23 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:15:23 INFO mapred.MapTask: Finished spill 1 16/08/17 21:15:24 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:15:24 INFO mapred.MapTask: Finished spill 2 16/08/17 21:15:24 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:15:24 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 29394704 bytes 16/08/17 21:15:24 INFO mapred.TaskRunner: Task:attempt_local_0008_m_000004_0 is done. And is in the process of commiting 16/08/17 21:15:24 INFO mapred.LocalJobRunner: 16/08/17 21:15:24 INFO mapred.TaskRunner: Task 'attempt_local_0008_m_000004_0' done. 16/08/17 21:15:24 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:15:24 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:15:24 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:15:25 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:25 INFO mapred.MapTask: bufstart = 0; bufend = 11793190; bufvoid = 99614720 16/08/17 21:15:25 INFO mapred.MapTask: kvstart = 0; kvend = 262144; length = 327680 16/08/17 21:15:26 INFO mapred.MapTask: Finished spill 0 16/08/17 21:15:27 INFO mapred.MapTask: Spilling map output: record full = true 16/08/17 21:15:27 INFO mapred.MapTask: bufstart = 11793190; bufend = 22746570; bufvoid = 99614720 16/08/17 21:15:27 INFO mapred.MapTask: kvstart = 262144; kvend = 196607; length = 327680 16/08/17 21:15:28 INFO mapred.MapTask: Finished spill 1 16/08/17 21:15:28 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:15:28 INFO mapred.MapTask: Finished spill 2 16/08/17 21:15:28 INFO mapred.Merger: Merging 3 sorted segments 16/08/17 21:15:28 INFO mapred.Merger: Down to the last merge-pass, with 3 segments left of total size: 29324068 bytes 16/08/17 21:15:29 INFO mapred.TaskRunner: Task:attempt_local_0008_m_000005_0 is done. And is in the process of commiting 16/08/17 21:15:29 INFO mapred.LocalJobRunner: 16/08/17 21:15:29 INFO mapred.TaskRunner: Task 'attempt_local_0008_m_000005_0' done. 16/08/17 21:15:29 INFO mapred.MapTask: io.sort.mb = 100 16/08/17 21:15:29 INFO mapred.MapTask: data buffer = 79691776/99614720 16/08/17 21:15:29 INFO mapred.MapTask: record buffer = 262144/327680 16/08/17 21:15:30 INFO mapred.MapTask: Starting flush of map output 16/08/17 21:15:30 INFO mapred.MapTask: Finished spill 0 16/08/17 21:15:30 INFO mapred.TaskRunner: Task:attempt_local_0008_m_000006_0 is done. And is in the process of commiting 16/08/17 21:15:30 INFO mapred.LocalJobRunner: 16/08/17 21:15:30 INFO mapred.TaskRunner: Task 'attempt_local_0008_m_000006_0' done. 16/08/17 21:15:30 INFO mapred.LocalJobRunner: 16/08/17 21:15:30 INFO mapred.Merger: Merging 7 sorted segments 16/08/17 21:15:30 INFO mapred.Merger: Down to the last merge-pass, with 7 segments left of total size: 191814318 bytes 16/08/17 21:15:30 INFO mapred.LocalJobRunner: 16/08/17 21:15:30 INFO util.NativeCodeLoader: Loaded the native-hadoop library 16/08/17 21:15:30 INFO zlib.ZlibFactory: Successfully loaded & initialized native-zlib library 16/08/17 21:15:36 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:39 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:42 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:45 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:48 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:51 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:54 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:56 INFO mapred.TaskRunner: Task:attempt_local_0008_r_000000_0 is done. And is in the process of commiting 16/08/17 21:15:56 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:56 INFO mapred.TaskRunner: Task attempt_local_0008_r_000000_0 is allowed to commit now 16/08/17 21:15:56 INFO output.FileOutputCommitter: Saved output of task 'attempt_local_0008_r_000000_0' to pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/final 16/08/17 21:15:56 INFO mapred.LocalJobRunner: reduce > reduce 16/08/17 21:15:56 INFO mapred.TaskRunner: Task 'attempt_local_0008_r_000000_0' done. [SCHED] class edu.jhu.thrax.hadoop.jobs.OutputJob in state SUCCESS class edu.jhu.thrax.hadoop.jobs.TargetWordGivenSourceWordProbabilityJob SUCCESS class edu.jhu.thrax.hadoop.jobs.VocabularyJob SUCCESS class edu.jhu.thrax.hadoop.features.mapred.SourcePhraseGivenTargetFeature SUCCESS class edu.jhu.thrax.hadoop.jobs.SourceWordGivenTargetWordProbabilityJob SUCCESS class edu.jhu.thrax.hadoop.features.annotation.AnnotationFeatureJob SUCCESS class edu.jhu.thrax.hadoop.jobs.OutputJob SUCCESS class edu.jhu.thrax.hadoop.features.mapred.TargetPhraseGivenSourceFeature SUCCESS class edu.jhu.thrax.hadoop.jobs.ExtractionJob SUCCESS Work directory was pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/ To retrieve grammar: hadoop fs -getmerge pipeline-es-en-hiero-_home_bpaulin_joshua-tutorial_runs_1/final