[HIVE-15489] Alternatively use table scan stats for HoS - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 2.2.0
Fix Version/s: 2.3.0
Component/s: Spark, Statistics
Labels:
None

Description

For MapJoin in HoS, we should provide an option to only use stats in the TS rather than the populated stats in each of the join branch. This could be pretty conservative but more reliable.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-15489.7.patch
17/Feb/17 02:53
24 kB
Chao Sun
HIVE-15489.6.patch
14/Feb/17 06:09
10 kB
Chao Sun
HIVE-15489.3.patch
08/Feb/17 23:15
9 kB
Chao Sun
HIVE-15489.2.patch
21/Jan/17 07:32
9 kB
Chao Sun
HIVE-15489.1.patch
20/Jan/17 14:54
9 kB
Chao Sun
HIVE-15489.wip.patch
22/Dec/16 20:20
9 kB
Chao Sun

Issue Links

is related to

HIVE-16336 Rename hive.spark.use.file.size.for.mapjoin to hive.spark.use.ts.stats.for.mapjoin

Closed

relates to

HIVE-16328 HoS: more aggressive mapjoin optimization when hive.spark.use.ts.stats.for.mapjoin is true

Closed

HIVE-16336 Rename hive.spark.use.file.size.for.mapjoin to hive.spark.use.ts.stats.for.mapjoin

Closed

HIVE-16698 HoS should avoid mapjoin optimization in case of union and using table stats

Closed

Activity

People

Assignee:: Chao Sun

Reporter:: Chao Sun

Votes:: 0 Vote for this issue

Watchers:: 4 Start watching this issue

Dates

Created:: 21/Dec/16 21:47

Updated:: 24/Jul/17 06:53

Resolved:: 17/Feb/17 20:08