[GOBBLIN-1129] clean up staging table created by avro2orc pipeline - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Open
Priority: Major
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: None
Labels:
None

Description

During the avro2orc conversion, many staging tables are created, they are not cleaned up due to the pipeline failure, and next execution doesn't take care of the clean up, which caused the staging table taking many spaces in hive metastore.

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: Kuai Yu

Votes:: 0 Vote for this issue

Watchers:: 1 Start watching this issue

Dates

Created:: 27/Apr/20 19:05

Updated:: 05/May/20 18:46

Time Tracking

Estimated:

Not Specified

Remaining:

Logged:

20m