HBaseHCatStorageHandler fails to abort a transaction when used via HCatLoader
Partitions are created even when Jobs are aborted
Yes, we are not calling abortJob. Actually abortJob does not exist in 20.2. We shall add the hook now.
Attach a draft patch.
The signature of abortJob is
public void abortJob(JobContext jobContext, JobStatus.State state)
The method API and the reflection invocation in the patch need to be corrected.
I'm going to take a crack at this patch.
Just spoke with Rohini offline, she has a patch for this. Which just needs to be tested on 0.20.2.
Tested with 20.2 jars in classpath and invoking cleanupJob. It does not throw any error for JobStatus.
+1 (non-binding), I've tested the 0.10 patch on hadoop-0.23 and verified it fixes HCATALOG-451.
Patch looks good. I'm running the tests and will commit it if passes.
Committed on trunk. I'll test it on 0.10 next.
branch10 patch checked into branch-10.