[HDFS-9541] Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB

• Type: Improvement
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 0.20.1
• Fix Version/s: 2.9.0, 3.0.0-alpha1
• Component/s: libhdfs
• Target Version/s: 2.9.0
• Hadoop Flags: Reviewed
• Assignee: Colin P. McCabe
• Reporter: Colin P. McCabe
• Created: 10/Dec/15 22:22
• Updated: 30/Aug/16 01:22
• Resolved: 26/Jan/16 19:28

Description

We should have a new API in libhdfs which will support creating files with a default block size that is more than 31 bits in size. We should also make this a builder API so that it is easy to add more options later.

Issue Links

• is duplicated by: HDFS-8949 hdfsOpenFile() in HDFS C API does not support block sizes larger than 2GB
• is duplicated by: HDFS-9446 tSize of libhdfs in hadoop-2.7.1 is still int32_t