-
Type:
Bug
-
Status: Resolved
-
Priority:
Major
-
Resolution: Duplicate
-
Affects Version/s: 2.7.1
-
Fix Version/s: None
-
Component/s: None
-
Labels:None
-
Target Version/s:
hdfsOpenFile() has an int32 blocksize parameter which restricts the size of the blocks to 2GB, while FileSystem.create accepts a long blockSize parameter.
https://github.com/apache/hadoop/blob/c1d50a91f7c05e4aaf4655380c8dcd11703ff158/hadoop-hdfs-project/hadoop-hdfs/src/main/native/libhdfs/hdfs.h#L395 - int32 blocksize
https://hadoop.apache.org/docs/current/api/org/apache/hadoop/fs/FileSystem.html#create(org.apache.hadoop.fs.Path, boolean, int, short, long) - long blockSize
- duplicates
-
HDFS-9541 Add hdfsStreamBuilder API to libhdfs to support defaultBlockSizes greater than 2 GB
-
- Resolved
-