-
Type:
Bug
-
Status: Closed
-
Priority:
Minor
-
Resolution: Fixed
-
Affects Version/s: 1.1.0
-
Fix Version/s: 2.1.0-beta
-
Component/s: contrib/gridmix
-
Labels:None
-
Hadoop Flags:Reviewed
-
Release Note:Bug fixed in compression emulation feature for map only jobs.
-
Tags:gridmix compression-emulation map-only-jobs
While running 1400+ jobs trace I encountered this issue.
For map-only jobs, observed that some Maps generating data of around 9 GB (From HDFS_BYTES_WRITTEN) whereas actual value is around 5GB in trace.
This can sometimes also cause jobs to fail intermittently.
Other GridMix version coming be Hadoop-1.1.X and above might also effected