[KYLIN-978] GarbageCollectionStep dropped Hive Intermediate Table but didn't drop external hdfs path - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Closed
Priority: Major
Resolution: Fixed
Affects Version/s: v0.7.2, v1.0
Fix Version/s: v1.1, v1.4.0
Component/s: Job Engine
Labels:
None

Description

In GarbageCollectionStep, the hive intermediate table created in step 1 was dropped.
As the table is external table, data was stored in a external hdfs path, like '.../kylin-${jobId}/kylin_intermediate_...', which didn't deleted when drop hive table.
Considering the purpose of GarbageCollectionStep, the external data path should also be deleted.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

KYLIN-978-1.x-staging-v2.patch
10/Sep/15 16:17
13 kB
Yerui Sun
KYLIN-978-2.x-staging.patch
18/Sep/15 11:17
15 kB
Yerui Sun
KYLIN-978-1.x-staging-v3.patch
18/Sep/15 14:18
23 kB
Yerui Sun

Activity

People

Assignee:: Shao Feng Shi

Reporter:: Yerui Sun

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 30/Aug/15 14:55

Updated:: 29/Sep/15 09:36

Resolved:: 22/Sep/15 05:54