[MAPREDUCE-5039] Configuration getInt is called From vaidya, but it actually need a float calculation(The values always be a Floating Poin Number)

• Type: Bug
• Status: Open
• Priority: Major
• Resolution: Unresolved
• Affects Version/s: 0.23.1
• Component/s: contrib/vaidya

Environment

hadoop-2.0.0-mr1-cdh4.1.2, Ubuntu 10.04

• Release Note: Using Hadoop: hadoop-2.0.0-mr1-cdh4.1.2
• Assignee: Unassigned
• Reporter: shobin joseph
• Due: 01/Mar/13
• Created: 01/Mar/13 11:00
• Updated: 05/Mar/13 05:43

Description

when we run the vaidya scrpit in hadoop-2.0.0-mr1-cdh4.1.2.

Exception:java.lang.NumberFormatException: For input string: "0.05"java.lang.NumberFormatException: For input string: "0.05"
at java.lang.NumberFormatException.forInputString(NumberFormatException.java:48)
at java.lang.Integer.parseInt(Integer.java:458)
at java.lang.Integer.parseInt(Integer.java:499)
at org.apache.hadoop.conf.Configuration.getInt(Configuration.java:887)
at org.apache.hadoop.vaidya.postexdiagnosis.tests.MapSideDiskSpill.getPrescription(MapSideDiskSpill.java:99)
at org.apache.hadoop.vaidya.DiagnosticTest.getReportElement(DiagnosticTest.java:283)
at org.apache.hadoop.vaidya.postexdiagnosis.PostExPerformanceDiagnoser.main(PostExPerformanceDiagnoser.java:254)

In the job conf file
the properties are like

<property><name>mapred.reduce.slowstart.completed.maps</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>

<property><name>io.sort.record.percent</name><value>0.05</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>

<property><name>io.sort.spill.percent</name><value>0.80</value><source>mapred-default.xml</source><source>/tmp/hadoop-527022/mapred/local/jobTracker/job_201302121643_0003.xml</source></property>

all the above lines throw the exception.

The important thing is default values for the above properties are 0.05 and 0.8

But the getInt() Function takes only integer values, if not it takes only the integer part.
In Hadoop io.sort.spill.percent,io.sort.record.percent,mapred.reduce.slowstart.completed.maps are expressed as Floating Point Numbers.