[HIVE-20056] SparkPartitionPruner shouldn't be triggered by Spark tasks - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Sub-task
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: None
Component/s: Spark
Labels:
None

Target Version/s:

4.0.0

Description

It looks like SparkDynamicPartitionPruner is being called by every Spark task because it gets created whenever getRecordReader is called on the associated InputFormat.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-20056.1.patch
14/Jul/18 17:55
7 kB
Sahil Takiar
HIVE-20056.2.patch
20/Jul/18 19:39
7 kB
Sahil Takiar

Activity

People

Assignee:: Sahil Takiar

Reporter:: Sahil Takiar

Votes:: 0 Vote for this issue

Watchers:: 2 Start watching this issue

Dates

Created:: 02/Jul/18 19:19

Updated:: 23/Jul/18 14:13

Resolved:: 23/Jul/18 14:13