[HIVE-20737] Local SparkContext is shared between user sessions and should be closed only when there is no active - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: None
Fix Version/s: 4.0.0-alpha-1
Component/s: Hive
Labels:
None

Description

1. Local SparkContext is shared between user sessions and should be closed only when there is no active.
2. Possible race condition in SparkSession.open() in case when user queries run in parallel within the same session.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-20737.1.patch
13/Oct/18 09:19
6 kB
Denys Kuzmenko
HIVE-20737.10.patch
16/Oct/18 16:45
14 kB
Denys Kuzmenko
HIVE-20737.11.patch
17/Oct/18 07:26
14 kB
Denys Kuzmenko
HIVE-20737.12.patch
17/Oct/18 22:10
14 kB
Denys Kuzmenko
HIVE-20737.2.patch
14/Oct/18 08:17
6 kB
Denys Kuzmenko
HIVE-20737.5.patch
14/Oct/18 22:13
12 kB
Denys Kuzmenko
HIVE-20737.6.patch
15/Oct/18 09:24
12 kB
Denys Kuzmenko
HIVE-20737.7.patch
15/Oct/18 16:42
14 kB
Denys Kuzmenko
HIVE-20737.8.patch
15/Oct/18 19:44
14 kB
Denys Kuzmenko
HIVE-20737.9.patch
15/Oct/18 21:23
14 kB
Denys Kuzmenko

Issue Links

is related to

HIVE-20695 HoS Query fails with hive.exec.parallel=true

Closed

HIVE-20742 SparkSessionManagerImpl maintenance thread only cleans up session once

Closed

links to

Review Board

Activity

People

Assignee:: Denys Kuzmenko

Reporter:: Denys Kuzmenko

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 12/Oct/18 17:57

Updated:: 17/Nov/22 08:55

Resolved:: 24/Oct/18 08:29