[BEAM-8289] Failing the job when the temporary file is accidentally deleted by another job in FileBasedSink - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Bug
Status: Open
Priority: P3
Resolution: Unresolved
Affects Version/s: None
Fix Version/s: None
Component/s: io-java-files
Labels:
None

Description

There was an issue that a temporary directory name is not unique in FileBasedSink (https://issues.apache.org/jira/browse/BEAM-7689) and we've changed the naming algorithm from timestamp to UUID. However, it looks like UUID is still not enough to distinguish two separate temporary directories from different jobs. We may need to fail the job when the temporary file is accidentally deleted by another job.

Attachments

Activity

People

Assignee:: Unassigned

Reporter:: Heejong Lee

Votes:: 0 Vote for this issue

Watchers:: 3 Start watching this issue

Dates

Created:: 20/Sep/19 00:37

Updated:: 04/Jun/22 13:52