Hadoop HDFS
  1. Hadoop HDFS
  2. HDFS-504

HDFS updates the modification time of a file when the file is closed.

    Details

    • Type: Improvement Improvement
    • Status: Closed
    • Priority: Minor Minor
    • Resolution: Fixed
    • Affects Version/s: 0.20.1
    • Fix Version/s: 0.21.0
    • Component/s: namenode
    • Labels:
      None
    • Hadoop Flags:
      Reviewed

      Description

      Current HDFS updates the modification time of a file when the file is created. We would like to update the modification time of the file when the file is closed after being written to. This helps HDFS Raid to detect file changes more aggressively.

      Solution includes:
      1. Made changes to closeFile@/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java;
      2. Added unit test to testTimesAtClose@/org/apache/hadoop/hdfs/TestSetTimes.java.

      1. pathfile.txt
        4 kB
        Chun Zhang
      2. pathfile.txt
        4 kB
        Chun Zhang
      3. pathfile.txt
        7 kB
        Chun Zhang
      4. pathfile.txt
        17 kB
        Chun Zhang

        Activity

        Chun Zhang created issue -
        Chun Zhang made changes -
        Field Original Value New Value
        Summary HDFS updates the modification time of a file when the file is created. HDFS updates the modification time of a file when the file is closed.
        Description HDFS updates the modification time of a file when the file is created. We would like to update the modification time of the file when the file is closed after being written to. This helps HDFS Raid to detect file changes more aggressively.

        Solution includes:
        1. Made changes to closeFile@/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java;
        2. Added unit test to testTimesAtClose@/org/apache/hadoop/hdfs/TestSetTimes.java.
        Current HDFS updates the modification time of a file when the file is created. We would like to update the modification time of the file when the file is closed after being written to. This helps HDFS Raid to detect file changes more aggressively.

        Solution includes:
        1. Made changes to closeFile@/org/apache/hadoop/hdfs/server/namenode/FSDirectory.java;
        2. Added unit test to testTimesAtClose@/org/apache/hadoop/hdfs/TestSetTimes.java.
        dhruba borthakur made changes -
        Assignee Chun Zhang [ chunzhang ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414472 ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414540 ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414675 ]
        Chun Zhang made changes -
        Attachment pathfile.txt [ 12414676 ]
        Chun Zhang made changes -
        Status Open [ 1 ] Patch Available [ 10002 ]
        dhruba borthakur made changes -
        Status Patch Available [ 10002 ] Resolved [ 5 ]
        Hadoop Flags [Reviewed]
        Resolution Fixed [ 1 ]
        dhruba borthakur made changes -
        Fix Version/s 0.21.0 [ 12314046 ]
        Fix Version/s 0.20.1 [ 12314048 ]
        Tom White made changes -
        Status Resolved [ 5 ] Closed [ 6 ]

          People

          • Assignee:
            Chun Zhang
            Reporter:
            Chun Zhang
          • Votes:
            0 Vote for this issue
            Watchers:
            4 Start watching this issue

            Dates

            • Created:
              Updated:
              Resolved:

              Time Tracking

              Estimated:
              Original Estimate - 2h
              2h
              Remaining:
              Remaining Estimate - 2h
              2h
              Logged:
              Time Spent - Not Specified
              Not Specified

                Development