[HUDI-5003] InLineFileSystem will throw NumberFormatException, cause the type of startOffset is int and out of bounds

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Fix Version/s: 0.12.2
• Labels: pull-request-available
• Assignee: wulei0302
• Reporter: wulei0302
• Created: 11/Oct/22 03:52
• Updated: 31/Oct/22 19:44
• Resolved: 31/Oct/22 19:44

Description

Caused by: java.lang.NumberFormatException: For input string: "2149686293"
	at java.lang.NumberFormatException.forInputString(NumberFormatException.java:65)
	at java.lang.Integer.parseInt(Integer.java:583)
	at java.lang.Integer.parseInt(Integer.java:615)
	at org.apache.hudi.common.fs.inline.InLineFSUtils.startOffset(InLineFSUtils.java:101)
	at org.apache.hudi.common.fs.inline.InLineFileSystem.open(InLineFileSystem.java:69)
	at org.apache.hadoop.fs.FileSystem.open(FileSystem.java:781)
	at org.apache.parquet.hadoop.util.HadoopInputFile.newStream(HadoopInputFile.java:65)
	at org.apache.parquet.hadoop.ParquetFileReader.<init>(ParquetFileReader.java:725)
	at org.apache.parquet.hadoop.ParquetFileReader.open(ParquetFileReader.java:603)
	at org.apache.parquet.hadoop.ParquetReader.initReader(ParquetReader.java:152)
	at org.apache.parquet.hadoop.ParquetReader.read(ParquetReader.java:135)
	at org.apache.hudi.common.util.ParquetReaderIterator.hasNext(ParquetReaderIterator.java:49)
	at java.util.Iterator.forEachRemaining(Iterator.java:115)
	at org.apache.hudi.common.table.log.block.HoodieParquetDataBlock.createRecordsFromContentBytes(HoodieParquetDataBlock.java:167)
	at org.apache.hudi.common.table.log.block.HoodieDataBlock.getRecords(HoodieDataBlock.java:104)
	at org.apache.hudi.common.table.log.AbstractHoodieLogRecordScanner.processDataBlock(AbstractHoodieLogRecordScanner.java:324)
	at org.apache.hudi.common.table.log.AbstractHoodieLogRecordScanner.processQueuedBlocksForInstant(AbstractHoodieLogRecordScanner.java:369)
	at org.apache.hudi.common.table.log.AbstractHoodieLogRecordScanner.scan(AbstractHoodieLogRecordScanner.java:197)

Issue Links

• links to: GitHub Pull Request #6916