[HIVE-14895] CompactorMR.CompactorOutputCommitter race condition - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Resolved
Priority: Major
Resolution: Fixed
Affects Version/s: 0.14.0
Fix Version/s: 2.3.0
Component/s: None
Labels:
None

Target Version/s:

1.3.0, 2.1.2

Description

commitJob() method renames each file in TMP_LOCATION separately. so someone may read FINAL_LOCATION and see only some of the files that should be there.
Use FileSystem.getFileStatus(TMP_LOCATION) and just rename the dir.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

HIVE-14895.01.patch
03/Dec/16 01:07
0.8 kB
Eugene Koifman
HIVE-14895.02.patch
04/Dec/16 18:45
0.8 kB
Eugene Koifman
HIVE-14895.03.patch
05/Dec/16 20:04
1 kB
Eugene Koifman

Activity

People

Assignee:: Eugene Koifman

Reporter:: Eugene Koifman

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 05/Oct/16 19:48

Updated:: 21/Jul/17 18:12

Resolved:: 07/Dec/16 04:22