[HADOOP-8642] Document that io.native.lib.available only controls native bz2 and zlib compression codecs

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.0.0-alpha
• Fix Version/s: 2.7.0
• Component/s: documentation, native
• Target Version/s: 2.7.0
• Hadoop Flags: Reviewed
• Assignee: Akira Ajisaka
• Reporter: Eli Collins
• Created: 02/Aug/12 17:13
• Updated: 06/Apr/16 06:57
• Resolved: 24/Feb/15 01:37

Description

Per core-default.xml io.native.lib.available indicates "Should native hadoop libraries, if present, be used" however it looks like it only affects bzip2 and zlib. Even if we set io.native.lib.available to false, native libraries are loaded and the libraries other than bzip2 and zlib are actually used. We should document that.

Issue Links

• is related to: HADOOP-11334 Mapreduce Job Failed due to failure fetching mapper output on the reduce side
• is related to: HADOOP-11627 Remove io.native.lib.available
• relates to: HADOOP-1570 Add a per-job configuration knob to control loading of native hadoop libraries
• relates to: HADOOP-10452 BUILDING.txt needs to be updated
• relates to: HADOOP-10409 Bzip2 error message isn't clear