[HIVE-10809] HCat FileOutputCommitterContainer leaves behind empty _SCRATCH directories

• Type: Bug
• Status: Resolved
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.2.0
• Fix Version/s: 2.3.0
• Component/s: HCatalog
• Target Version/s: 1.3.0, 2.2.0
• Hadoop Flags: Reviewed
• Assignee: Selina Zhang
• Reporter: Selina Zhang
• Created: 23/May/15 04:09
• Updated: 21/Jul/17 17:45
• Resolved: 03/Sep/16 00:39

Description

When static partition is added through HCatStorer or HCatWriter

JoinedData = LOAD '/user/selinaz/data/part-r-00000' USING JsonLoader();
STORE JoinedData INTO 'selina.joined_events_e' USING org.apache.hive.hcatalog.pig.HCatStorer('author=selina');

The table directory looks like

drwx------   - selinaz users          0 2015-05-22 21:19 /user/selinaz/joined_events_e/_SCRATCH0.9157208938193798
drwx------   - selinaz users          0 2015-05-22 21:19 /user/selinaz/joined_events_e/author=selina