[HADOOP-13946] Document how HDFS updates timestamps in the FS spec; compare with object stores - ASF JIRA

XML

Word

Printable

JSON

Details

Type: Improvement
Status: Resolved
Priority: Minor
Resolution: Fixed
Affects Version/s: 2.7.3
Fix Version/s: 2.8.0, 3.0.0-alpha4
Component/s: documentation, fs
Labels:
None

Target Version/s:

2.8.1
Hadoop Flags:

Reviewed

Description

~~SPARK-17159~~ shows that the behavior of when HDFS updates timestamps isn't well documented. Document these in the FS spec.

I'm not going to add tests for this, as it is so very dependent on FS implementations, as in "POSIX filesystems may behave differently from HDFS". If someone knows what happens there, their contribution is welcome.

Attachments

- Sort By Name
- Sort By Date
- Ascending
- Descending

Screen Shot 2017-03-07 at 3.44.43 PM.png
07/Mar/17 23:45
679 kB
Mingliang Liu
HADOOP-13946-005.patch
07/Mar/17 23:24
5 kB
Mingliang Liu
HADOOP-13946-004.patch
23/Jan/17 15:23
5 kB
Steve Loughran
HADOOP-13946-003.patch
23/Jan/17 14:06
4 kB
Steve Loughran
HADOOP-13946-002.patch
08/Jan/17 13:29
4 kB
Steve Loughran
HADOOP-13946-001.patch
03/Jan/17 15:01
2 kB
Steve Loughran

Issue Links

relates to

SPARK-17159 Improve FileInputDStream.findNewFiles list performance

Resolved

Activity

People

Assignee:: Steve Loughran

Reporter:: Steve Loughran

Votes:: 0 Vote for this issue

Watchers:: 9 Start watching this issue

Dates

Created:: 03/Jan/17 14:44

Updated:: 10/Mar/17 08:23

Resolved:: 10/Mar/17 08:23