[YUNIKORN-1178] Nil pointer dereference during schedule recovery

• Type: Bug
• Status: Closed
• Priority: Blocker
• Resolution: Fixed
• Fix Version/s: 1.0.0
• Component/s: shim - kubernetes
• Labels: pull-request-available
• Target Version: 1.0.0
• Assignee: Craig Condit
• Reporter: Craig Condit
• Created: 13/Apr/22 20:39
• Updated: 04/May/22 23:52
• Resolved: 13/Apr/22 21:15

Description

Observed a SIGSEGV during context recovery:

2022-04-13T20:34:42.675Z    INFO    cache/node.go:109    add existing allocation    {"nodeID": "yk8s-worker", "allocation": "allocationKey:\"8bf3b33c-4dd9 
panic: runtime error: invalid memory address or nil pointer dereference                                                                                    
[signal SIGSEGV: segmentation violation code=0x1 addr=0x58 pc=0x17b34d7]                                                                                   
                                                                                                                                                            
goroutine 196 [running]:                                                                                                                                   
github.com/apache/yunikorn-k8shim/pkg/cache.(*Context).recover(0xc00013d2c0, 0xc003de8210, 0x1, 0x1, 0x45d964b800, 0x1, 0xc003d03d28)                      
    /Users/ccondit/yunikorn/yunikorn-k8shim/pkg/cache/context_recovery.go:121 +0x1e77                                                                      
github.com/apache/yunikorn-k8shim/pkg/cache.(*Context).WaitForRecovery(0xc00013d2c0, 0xc003de8210, 0x1, 0x1, 0x45d964b800, 0xc003de8210, 0x0)              
    /Users/ccondit/yunikorn/yunikorn-k8shim/pkg/cache/context_recovery.go:46 +0xb3                                                                         
github.com/apache/yunikorn-k8shim/pkg/shim.(*KubernetesShim).recoverSchedulerState.func1(0xc0005295c0)                                                     
    /Users/ccondit/yunikorn/yunikorn-k8shim/pkg/shim/scheduler.go:216 +0x1e5                                                                               
created by github.com/apache/yunikorn-k8shim/pkg/shim.(*KubernetesShim).recoverSchedulerState                                                              
    /Users/ccondit/yunikorn/yunikorn-k8shim/pkg/shim/scheduler.go:191 +0x3f                                                                                
Stream closed EOF for yunikorn/yunikorn-scheduler-5b67d97447-7mds6 (yunikorn-scheduler-k8s)  

Issue Links

• links to: GitHub Pull Request #408