Uploaded image for project: 'Hadoop Common'
  1. Hadoop Common
  2. HADOOP-13946

Document how HDFS updates timestamps in the FS spec; compare with object stores

    Details

    • Type: Improvement
    • Status: Resolved
    • Priority: Minor
    • Resolution: Fixed
    • Affects Version/s: 2.7.3
    • Fix Version/s: 2.8.0, 3.0.0-alpha4
    • Component/s: documentation, fs
    • Labels:
      None
    • Target Version/s:
    • Hadoop Flags:
      Reviewed

      Description

      SPARK-17159 shows that the behavior of when HDFS updates timestamps isn't well documented. Document these in the FS spec.

      I'm not going to add tests for this, as it is so very dependent on FS implementations, as in "POSIX filesystems may behave differently from HDFS". If someone knows what happens there, their contribution is welcome.

        Attachments

        1. HADOOP-13946-001.patch
          2 kB
          Steve Loughran
        2. HADOOP-13946-002.patch
          4 kB
          Steve Loughran
        3. HADOOP-13946-003.patch
          4 kB
          Steve Loughran
        4. HADOOP-13946-004.patch
          5 kB
          Steve Loughran
        5. HADOOP-13946-005.patch
          5 kB
          Mingliang Liu
        6. Screen Shot 2017-03-07 at 3.44.43 PM.png
          679 kB
          Mingliang Liu

          Issue Links

            Activity

              People

              • Assignee:
                stevel@apache.org Steve Loughran
                Reporter:
                stevel@apache.org Steve Loughran
              • Votes:
                0 Vote for this issue
                Watchers:
                9 Start watching this issue

                Dates

                • Created:
                  Updated:
                  Resolved: