[HIVE-11541] ORC: Split Strategy should depend on global file count, not per-partition

• Type: Bug
• Status: Closed
• Priority: Major
• Resolution: Fixed
• Affects Version/s: 1.3.0, 2.0.0
• Fix Version/s: 1.3.0, 2.0.0
• Component/s: File Formats
• Assignee: Gopal Vijayaraghavan
• Reporter: Gopal Vijayaraghavan
• Created: 12/Aug/15 23:14
• Updated: 16/Feb/16 23:52
• Resolved: 13/Aug/15 19:39

Description

A partitioned table with 4000 partitions and 200 files each doesn't trigger the BISplitStrategy, because each partition qualifies as a Strategy future instead of using the atomic counter upfront.