Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-504

HDFS updates the modification time of a file when the file is closed.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20.1
    • Fix Version/s: 0.21.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Current HDFS updates the modification time of a file when the file is created. We would like to update the modification time of the file when the file is closed after being written to. This helps HDFS Raid to detect file changes more aggressively.

      Solution includes:
      1. Made changes to closeFile@/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java;
      2. Added unit test to testTimesAtClose@/org/apache/hadoop/hdfs/TestSetTimes.java.

      1. pathfile.txt
        17 kB
        Chun Zhang
      2. pathfile.txt
        7 kB
        Chun Zhang
      3. pathfile.txt
        4 kB
        Chun Zhang
      4. pathfile.txt
        4 kB
        Chun Zhang

        Activity

        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]
        dhruba borthakur made changes -
        Fix Version/s 0.21.0 [ 12314046 ]
        Fix Version/s 0.20.1 [ 12314048 ]
        dhruba borthakur made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        Chun Zhang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414676 ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414675 ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414540 ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414472 ]
        dhruba borthakur made changes -
        Assignee Chun Zhang [ chunzhang ]
        Chun Zhang made changes -
        Field Original Value New Value
        Summary HDFS updates the modification time of a file when the file is created. HDFS updates the modification time of a file when the file is closed.
        Description HDFS updates the modification time of a file when the file is created. We would like to update the modification time of the file when the file is closed after being written to. This helps HDFS Raid to detect file changes more aggressively.

        Solution includes:
        1. Made changes to closeFile@/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java;
        2. Added unit test to testTimesAtClose@/org/apache/hadoop/hdfs/TestSetTimes.java.
        Current HDFS updates the modification time of a file when the file is created. We would like to update the modification time of the file when the file is closed after being written to. This helps HDFS Raid to detect file changes more aggressively.

        Solution includes:
        1. Made changes to closeFile@/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java;
        2. Added unit test to testTimesAtClose@/org/apache/hadoop/hdfs/TestSetTimes.java.
        Chun Zhang created issue -

          People

          • Assignee:
            Chun Zhang
            Reporter:
            Chun Zhang
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 2h
              2h
              Remaining:
              Remaining Estimate - 2h
              2h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development