[KAFKA-9704] z/OS won't let us resize file when mmap

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 2.4.0
• Fix Version/s: 2.6.0, 2.4.2, 2.5.1
• Component/s: log
• Assignee: Shuo Zhang
• Reporter: Shuo Zhang
• Created: 11/Mar/20 09:32
• Updated: 01/Nov/21 08:56
• Resolved: 24/Apr/20 14:25

Description

z/OS won't let us resize file when mmap, so we need to force unman like Windows.

 
It was found that if messages were ever published to the Kafka server, the Kafka server will not restart. The issue occurs repeatedly in two of our guest z/OS systems.
 
java.io.IOException: EDC5121I Invalid argument.                                                   
 at sun.nio.ch.FileChannelImpl.map0(Native Method)                                                
 at sun.nio.ch.FileChannelImpl.map(FileChannelImpl.java:946)                                      
 at kafka.log.AbstractIndex.$anonfun$resize$1(AbstractIndex.scala:190)                            
 at kafka.log.AbstractIndex$$Lambda$238.00000000D24C4D30.apply$mcZ$sp(Unknown Source)             
 at scala.runtime.java8.JFunction0$mcZ$sp.apply(JFunction0$mcZ$sp.java:23)                        
 at kafka.utils.CoreUtils$.inLock(CoreUtils.scala:253)                                            
 at kafka.log.AbstractIndex.resize(AbstractIndex.scala:174)                                       
 at kafka.log.LogSegment.resizeIndexes(LogSegment.scala:77)                                       
 at kafka.log.Log.loadSegments(Log.scala:728)                                                     
 at kafka.log.Log.<init>(Log.scala:298)                                                           
 at kafka.log.Log$.apply(Log.scala:2461)                                                          
 at kafka.log.LogManager.loadLog(LogManager.scala:283)                                            
 at kafka.log.LogManager.$anonfun$loadLogs$12(LogManager.scala:353)                               
 at kafka.log.LogManager$$Lambda$198.00000000C9F511B0.apply$mcV$sp(Unknown Source)                
 at kafka.utils.CoreUtils$$anon$1.run(CoreUtils.scala:65)                                         
 at java.util.concurrent.Executors$RunnableAdapter.call(Executors.java:522)                       
 at java.util.concurrent.FutureTask.run(FutureTask.java:277)                                      
 at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1160)               
 at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:635)               
 at java.lang.Thread.run(Thread.java:812)                                                         

Issue Links

• links to: GitHub Pull Request #8224